-- Logs begin at Thu 2021-05-20 19:47:31 UTC, end at Thu 2021-05-20 20:56:30 UTC. -- May 20 20:18:48.763475 dv-cinder-784623-13-iscsi systemd[1]: Started Devstack devstack@q-svc.service. May 20 20:18:51.166956 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.common.config [-] Logging enabled! May 20 20:18:51.168158 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev225 May 20 20:18:51.168373 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91540) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 20 20:18:51.171517 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.common.config [-] Logging enabled! May 20 20:18:51.172027 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev225 May 20 20:18:51.172138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91540) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 20 20:18:51.173276 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 20 20:18:51.173503 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 20 20:18:51.173855 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 20 20:18:51.174097 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 20 20:18:51.174318 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 20 20:18:51.174635 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.174930 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.175223 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.175448 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.175739 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.176048 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.176327 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.176610 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.176903 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.177180 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.177457 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.177736 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.177959 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.178232 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] config_source = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.178513 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.178792 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.179010 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] debug = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.179343 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.179800 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.180218 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.180496 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.180781 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.181058 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.181324 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.181598 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.181895 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.182203 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] host = dv-cinder-784623-13-iscsi {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.182618 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.182984 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.183359 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.183746 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.184042 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.184320 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.184605 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.184878 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] log_dir = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.185151 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] log_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.185427 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.185714 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.186002 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.186327 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.186512 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.186740 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.187020 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.187303 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.187576 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.187878 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.188153 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.188426 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.188697 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.188964 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.189246 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.189526 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.189808 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.190080 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.190351 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.190619 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.190886 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.191164 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.191433 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.191702 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.192003 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.192284 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.192551 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.192826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.193123 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.193409 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.193679 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.193958 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.194229 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.194506 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.194776 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.195046 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] use_journal = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.195316 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] use_json = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.195584 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.195876 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.196157 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.196427 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.196696 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.196967 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.197235 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.197515 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:51.197811 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.198104 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.198449 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.198728 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.199079 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.199371 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.199660 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.199962 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.200251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.200536 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.200827 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.201106 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.201395 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.201671 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.201966 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.202269 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.202571 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.202867 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.203142 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.203415 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.203688 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.203988 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.204277 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.204569 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.204858 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.205131 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.205412 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.205699 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.205976 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.206246 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.206525 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.207077 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.207077 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.207331 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.207612 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.207914 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.208188 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.208458 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.208735 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.209020 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.209296 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.209564 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.209831 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.210106 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.210378 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.210662 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.210938 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.211207 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.211477 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.211752 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.212044 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.212314 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.212596 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.212865 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.213143 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.213410 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.213680 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.213949 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.215032 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.215032 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.215314 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.215589 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.215896 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.216175 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.216448 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.216722 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.216996 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.217269 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.217557 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.217853 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.218132 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.218411 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.218691 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.218966 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.219245 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.219520 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.219823 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.220099 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.220371 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.220657 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.220940 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.221222 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.221507 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.221783 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.222075 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.222352 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.222638 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.222920 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.223200 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.223540 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.223785 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.224076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.224366 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.224654 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.224984 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.225232 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.225512 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.225819 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.226096 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:51.226309 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 20 20:18:51.226547 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=91540) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} May 20 20:18:51.574324 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=91540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:18:51.574522 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=91540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:18:51.574791 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=91540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:18:51.575115 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [-] Loading core plugin: ml2 May 20 20:18:51.881522 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:51.881811 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:51.882077 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:51.883261 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:51.883528 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:51.883809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.003416 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.003692 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.003977 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.017558 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.017832 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.018097 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.045815 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.046085 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.046348 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.085104 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.085380 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.085642 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.317694 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.318325 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.318325 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.318532 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.319190 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.442079 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.442385 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.442662 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.442934 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.443199 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.443503 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.443756 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.444098 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.444347 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.444621 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.444875 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.445136 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.445394 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.445646 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.445904 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.446165 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.446415 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.446823 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.447079 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.447356 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.447702 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.447978 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.448223 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.448797 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.448797 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.449033 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.449433 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:52.449656 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:52.449880 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:52.450109 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:52.450340 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:52.450570 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:52.450928 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] May 20 20:18:52.453990 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] May 20 20:18:52.457887 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 20 20:18:52.461568 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(800, 849)])]) May 20 20:18:52.463167 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] May 20 20:18:52.463605 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) May 20 20:18:52.464483 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] May 20 20:18:52.464986 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] May 20 20:18:52.467780 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] May 20 20:18:52.468028 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] May 20 20:18:52.468367 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] May 20 20:18:52.496773 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] May 20 20:18:52.497291 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.497585 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=91540) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} May 20 20:18:52.497942 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.499283 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=91540) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} May 20 20:18:52.499560 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] May 20 20:18:52.499829 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] May 20 20:18:52.503004 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.503283 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:52.574407 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 20 20:18:52.574641 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 20 20:18:52.574873 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 20 20:18:52.575240 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] May 20 20:18:52.606084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_db.sqlalchemy.engines [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 20:18:52.936207 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing driver for type 'gre' May 20 20:18:52.936726 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] gre ID ranges: [(1, 1000)] May 20 20:18:52.989071 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing driver for type 'local' May 20 20:18:52.989425 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing driver for type 'vlan' May 20 20:18:53.002241 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] VlanTypeDriver initialization complete May 20 20:18:53.002593 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing driver for type 'vxlan' May 20 20:18:53.003079 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] vxlan ID ranges: [(1, 1000)] May 20 20:18:53.056914 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing extension driver 'port_security' May 20 20:18:53.057375 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.extensions.port_security [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] PortSecurityExtensionDriver initialization complete May 20 20:18:53.057733 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing mechanism driver 'openvswitch' May 20 20:18:53.058703 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing mechanism driver 'hyperv' May 20 20:18:53.065250 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.plugins.ml2.plugin [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=91540) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:18:53.065991 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.066354 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.066733 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.067110 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnet after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.067455 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnet after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.067812 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnet after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.068184 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.068521 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.068853 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.069217 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > security_group after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.069554 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > security_group after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.069886 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > security_group after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.070253 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.070593 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.070924 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.071291 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > address_group after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.071624 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > address_group after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.071974 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > address_group after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.072307 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] ML2 OVO RPC backend initialized. {{(pid=91540) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}} May 20 20:18:53.073003 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router_interface after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.073386 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.073810 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.074166 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > networks before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.074505 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.074837 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > ports before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.075169 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnet before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.075502 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnets before_response 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.075864 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.076199 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.076525 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.076853 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.077181 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.077504 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.077832 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnet after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.078156 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnet after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.078479 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > subnet after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.079039 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.plugin [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Modular L2 Plugin initialization complete May 20 20:18:53.079352 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading services supported by the core plugin {{(pid=91540) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} May 20 20:18:53.079664 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.plugins.ml2.managers [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Got port-security extension from driver 'port_security' May 20 20:18:53.080138 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.extensions.vlantransparent [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Disabled vlantransparent extension. May 20 20:18:53.080837 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=91540) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} May 20 20:18:53.081275 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: router May 20 20:18:53.118734 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router_interface before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.119121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router after_create 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.119483 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router before_create 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.119871 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.120371 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.121241 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router after_delete 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.121593 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > floatingip after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.121942 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router after_create 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.122281 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router after_update 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.122623 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router after_update 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.122959 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.123306 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router after_update 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.123702 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_update 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.124081 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: port after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.124406 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: port after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.124729 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: subnet after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.125053 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.125387 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > port precommit_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.125720 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_create 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.126045 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: port before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.126372 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.126713 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router after_update 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.127042 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_delete 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.127374 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_create 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.127721 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router_interface after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.128073 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_update 55549900 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.128429 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > network after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.129260 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Tracking information for resource: router configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:53.129578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Tracking information for resource: floatingip configured {{(pid=91540) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 20 20:18:53.134464 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.db.l3_agentschedulers_db [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. May 20 20:18:53.135021 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: port after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.135370 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: port after_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.135708 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: port after_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.136208 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: port after_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.136989 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router before_create 55550100 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.137341 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_delete 55550100 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.137690 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_create 55550100 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.138033 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > router precommit_update 55550100 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.142465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.services.provider_configuration [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service providers = [] {{(pid=91540) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} May 20 20:18:53.142819 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.db.servicetype_db [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=91540) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} May 20 20:18:53.145703 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.services.service_base [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=91540) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 20 20:18:53.146041 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.services.service_base [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=91540) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 20 20:18:53.146369 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.services.service_base [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=91540) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 20 20:18:53.147220 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.services.service_base [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=91540) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 20 20:18:53.147578 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.services.service_base [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Default provider is not specified for service type L3_ROUTER_NAT May 20 20:18:53.148149 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.148460 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin May 20 20:18:53.158791 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.159117 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: auto_allocate May 20 20:18:53.164730 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: network precommit_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.165088 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: network precommit_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.165593 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.165902 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: tag May 20 20:18:53.173352 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.173668 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: timestamp May 20 20:18:53.177389 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.177711 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: network_ip_availability May 20 20:18:53.183562 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.183952 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.184301 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.184998 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.185308 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: flavors May 20 20:18:53.190204 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.190480 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading Plugin: revisions May 20 20:18:53.194647 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=91540) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 20 20:18:53.195027 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_concurrency.lockutils [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.620s {{(pid=91540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:18:53.195744 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=91540) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} May 20 20:18:53.196093 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Initializing extension manager. May 20 20:18:53.196585 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: __init__.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.196915 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: __pycache__ {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.197237 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.197561 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: address_group.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.198339 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.198910 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: address-group May 20 20:18:53.199283 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: address_scope.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.200008 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.200502 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: address-scope May 20 20:18:53.200810 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: admin_state_down_before_update.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.201698 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.202196 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: router-admin-state-down-before-update May 20 20:18:53.202607 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: agent.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.203292 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.203804 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: agent May 20 20:18:53.204116 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: agent_resources_synced.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.205009 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.205506 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: agent-resources-synced May 20 20:18:53.205816 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: allowedaddresspairs.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.207553 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.208089 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: allowed-address-pairs May 20 20:18:53.208406 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: auto_allocated_topology.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.209471 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.209977 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: auto-allocated-topology May 20 20:18:53.210292 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: availability_zone.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.210963 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.211456 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: availability_zone May 20 20:18:53.211783 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: availability_zone_filter.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.212668 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.213163 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: availability_zone_filter May 20 20:18:53.213473 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: data_plane_status.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.214923 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.215416 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension data-plane-status not supported by any of loaded plugins May 20 20:18:53.215727 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: default_subnetpools.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.216635 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.217123 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: default-subnetpools May 20 20:18:53.217434 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: dhcpagentscheduler.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.218222 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.218713 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: dhcp_agent_scheduler May 20 20:18:53.219022 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: dns.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.219927 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.220416 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension dns-integration not supported by any of loaded plugins May 20 20:18:53.220727 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: dns_domain_ports.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.221604 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.222094 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension dns-domain-ports not supported by any of loaded plugins May 20 20:18:53.222406 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: dvr.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.223057 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.223545 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: dvr May 20 20:18:53.223877 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: empty_string_filtering.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.224766 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.225261 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: empty-string-filtering May 20 20:18:53.225572 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.226459 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.226947 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 20 20:18:53.227255 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.228161 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.228651 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 20 20:18:53.228957 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: external_net.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.230745 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.231020 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: external-net May 20 20:18:53.231324 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: extra_dhcp_opt.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.232256 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.232748 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: extra_dhcp_opt May 20 20:18:53.233052 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: extraroute.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.233928 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.234416 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: extraroute May 20 20:18:53.234722 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: extraroute_atomic.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.235730 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.236250 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: extraroute-atomic May 20 20:18:53.236556 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: filter_validation.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.237195 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.237688 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: filter-validation May 20 20:18:53.237992 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: fip_pf_description.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.239058 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.239555 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 20 20:18:53.239890 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: fip_port_details.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.240779 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.241274 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: fip-port-details May 20 20:18:53.241583 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: flavors.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.242793 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.243297 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: flavors May 20 20:18:53.243609 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.245506 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.246063 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 20 20:18:53.246386 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: floatingip_pools.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.247069 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.247569 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: floatingip-pools May 20 20:18:53.247920 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: ip_allocation.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.248806 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.249303 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension ip_allocation not supported by any of loaded plugins May 20 20:18:53.249617 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.250498 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.250998 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: ip-substring-filtering May 20 20:18:53.251311 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l2_adjacency.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.252252 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.252747 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension l2_adjacency not supported by any of loaded plugins May 20 20:18:53.253060 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l3.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.254164 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.254644 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: router May 20 20:18:53.254956 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l3_conntrack_helper.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.257193 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.257710 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 20 20:18:53.258032 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.258932 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.259438 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: ext-gw-mode May 20 20:18:53.259753 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.260667 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.261397 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: l3-ha May 20 20:18:53.261625 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l3_flavors.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.262508 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.263003 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: l3-flavors May 20 20:18:53.263313 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.264222 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.264724 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: l3-port-ip-change-not-allowed May 20 20:18:53.265037 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: l3agentscheduler.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.266051 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.266551 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: l3_agent_scheduler May 20 20:18:53.266868 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: logging.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.268341 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.268846 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension logging not supported by any of loaded plugins May 20 20:18:53.269162 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: metering.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.269880 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.270441 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: metering May 20 20:18:53.270755 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.271859 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.272364 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: metering_source_and_destination_fields May 20 20:18:53.272679 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: multiprovidernet.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.273685 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.274179 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: multi-provider May 20 20:18:53.274493 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: netmtu.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.275370 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.275896 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: net-mtu May 20 20:18:53.276209 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: netmtu_writable.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.277789 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.278283 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: net-mtu-writable May 20 20:18:53.278590 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: network_availability_zone.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.279233 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.279730 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: network_availability_zone May 20 20:18:53.280061 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: network_ip_availability.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.281117 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.281608 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: network-ip-availability May 20 20:18:53.281918 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: network_segment_range.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.282648 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.283138 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension network-segment-range not supported by any of loaded plugins May 20 20:18:53.283448 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: pagination.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.284421 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.284740 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: pagination May 20 20:18:53.285047 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: port_device_profile.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.285930 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.286426 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: port-device-profile May 20 20:18:53.286735 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.287629 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.288168 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: port-mac-address-regenerate May 20 20:18:53.288479 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.289362 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.289854 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: port-numa-affinity-policy May 20 20:18:53.290160 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: port_resource_request.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.291030 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.291523 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension port-resource-request not supported by any of loaded plugins May 20 20:18:53.291860 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: portbindings.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.293443 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.293938 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: binding May 20 20:18:53.294246 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: portbindings_extended.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.295497 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.296028 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: binding-extended May 20 20:18:53.296335 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: portsecurity.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.297211 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.297967 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: port-security May 20 20:18:53.298276 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: project_id.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.299214 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.299538 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: project-id May 20 20:18:53.299880 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: providernet.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.300767 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.301262 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: provider May 20 20:18:53.301569 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.305232 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.305746 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos not supported by any of loaded plugins May 20 20:18:53.306068 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.307279 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.307978 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 20 20:18:53.308435 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.309157 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.309664 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 20 20:18:53.309981 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_default.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.310862 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.311358 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-default not supported by any of loaded plugins May 20 20:18:53.311669 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_fip.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.312322 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.312811 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-fip not supported by any of loaded plugins May 20 20:18:53.313121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_gateway_ip.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.314006 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.314504 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-gateway-ip not supported by any of loaded plugins May 20 20:18:53.314815 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_port_network_policy.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.315694 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.316217 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-port-network-policy not supported by any of loaded plugins May 20 20:18:53.316655 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_rule_type_details.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.317417 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.317904 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-rule-type-details not supported by any of loaded plugins May 20 20:18:53.318418 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: qos_rules_alias.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.319232 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.319733 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension qos-rules-alias not supported by any of loaded plugins May 20 20:18:53.320067 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: quotasv2.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.321085 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.321402 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: quotas May 20 20:18:53.321713 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: quotasv2_detail.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.323300 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.323979 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: quota_details May 20 20:18:53.323979 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: rbac.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.325030 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.325546 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: rbac-policies May 20 20:18:53.325863 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: rbac_address_group.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.326760 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.327263 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: rbac-address-group May 20 20:18:53.327574 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: rbac_address_scope.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.328493 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.328996 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: rbac-address-scope May 20 20:18:53.329303 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: rbac_security_groups.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.330194 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.330687 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: rbac-security-groups May 20 20:18:53.330995 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: rbac_subnetpool.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.331922 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.332416 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: rbac-subnetpool May 20 20:18:53.332726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: revisionifmatch.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.333614 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.334109 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: revision-if-match May 20 20:18:53.334418 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: revisions.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.335497 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.336020 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: standard-attr-revisions May 20 20:18:53.336328 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: router_availability_zone.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.336969 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.337461 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: router_availability_zone May 20 20:18:53.337768 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: routerservicetype.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.338657 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.339676 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension router-service-type not supported by any of loaded plugins May 20 20:18:53.340018 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.340917 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.341413 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: security-groups-normalized-cidr May 20 20:18:53.341721 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: security_groups_port_filtering.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.342608 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.343101 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: port-security-groups-filtering May 20 20:18:53.343410 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.344322 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.344817 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: security-groups-remote-address-group May 20 20:18:53.345125 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: securitygroup.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.355702 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.356332 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: security-group May 20 20:18:53.356749 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: segment.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.357696 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.358260 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension segment not supported by any of loaded plugins May 20 20:18:53.358581 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.359815 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.360453 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 20 20:18:53.360809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: servicetype.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.362080 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.362695 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: service-type May 20 20:18:53.363044 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: sorting.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.364235 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.364639 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: sorting May 20 20:18:53.364993 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: standard_attr_segment.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.366060 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.366592 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension standard-attr-segment not supported by any of loaded plugins May 20 20:18:53.367081 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: standardattrdescription.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.367926 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.368496 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: standard-attr-description May 20 20:18:53.368932 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: stateful_security_group.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.369941 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.370565 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: stateful-security-group May 20 20:18:53.370952 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: stdattrs_common.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.371637 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 20 20:18:53.372060 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.373226 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.373851 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins May 20 20:18:53.374263 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: subnet_onboard.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.375587 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.376345 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: subnet_onboard May 20 20:18:53.376696 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.377992 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.378616 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 20 20:18:53.378966 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: subnet_service_types.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.380130 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.380802 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: subnet-service-types May 20 20:18:53.381147 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: subnetallocation.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.382378 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.382920 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: subnet_allocation May 20 20:18:53.383301 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.383979 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.384485 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: subnetpool-prefix-ops May 20 20:18:53.384793 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.385702 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.386409 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 20 20:18:53.386723 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: tagging.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.387830 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.388355 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: standard-attr-tag May 20 20:18:53.388669 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: timestamp.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.389852 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.390357 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loaded extension: standard-attr-timestamp May 20 20:18:53.390673 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: trunk.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.391679 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.392209 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension trunk not supported by any of loaded plugins May 20 20:18:53.392527 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: trunk_details.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.393435 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.393936 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension trunk-details not supported by any of loaded plugins May 20 20:18:53.394250 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: uplink_status_propagation.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.395152 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.395645 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension uplink-status-propagation not supported by any of loaded plugins May 20 20:18:53.395987 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Loading extension file: vlantransparent.py {{(pid=91540) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 20 20:18:53.396817 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=91540) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 20 20:18:53.397316 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extension vlan-transparent not supported by any of loaded plugins May 20 20:18:53.399925 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:network May 20 20:18:53.400653 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:subnet May 20 20:18:53.401418 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:subnetpool May 20 20:18:53.402703 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:port May 20 20:18:53.404006 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.404511 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service FLAVORS assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.405137 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.405553 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.405873 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:router May 20 20:18:53.406509 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:floatingip May 20 20:18:53.407202 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service METERING assigned prefix: /metering {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.408666 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.409028 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.409379 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91540) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:18:53.410508 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of CountableResource for resource:rbac_policy May 20 20:18:53.410951 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:security_group May 20 20:18:53.411590 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:security_group_rule May 20 20:18:53.412390 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service CORE assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.412711 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:subnetpool May 20 20:18:53.413038 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] subnetpool is already registered May 20 20:18:53.413631 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service CORE assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.413955 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:subnetpool May 20 20:18:53.414268 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] subnetpool is already registered May 20 20:18:53.418470 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.418892 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service FLAVORS assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.419479 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.419930 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.420258 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:router May 20 20:18:53.420573 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] router is already registered May 20 20:18:53.421152 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:floatingip May 20 20:18:53.421464 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] floatingip is already registered May 20 20:18:53.422078 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service METERING assigned prefix: /metering {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.423014 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of CountableResource for resource:rbac_policy May 20 20:18:53.423326 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] rbac_policy is already registered May 20 20:18:53.423880 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:security_group May 20 20:18:53.424195 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] security_group is already registered May 20 20:18:53.424772 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:security_group_rule May 20 20:18:53.425088 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] security_group_rule is already registered May 20 20:18:53.425740 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service CORE assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.426061 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:subnetpool May 20 20:18:53.426373 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] subnetpool is already registered May 20 20:18:53.426957 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.v2.resource_helper [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Service CORE assigned prefix: {{(pid=91540) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 20 20:18:53.427297 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Creating instance of TrackedResource for resource:subnetpool May 20 20:18:53.427607 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING neutron.quota.resource_registry [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] subnetpool is already registered May 20 20:18:53.428280 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: extensions {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.429735 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: address-groups {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.431314 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: address-scopes {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.432528 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: agents {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.433733 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: auto-allocated-topology {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.434937 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: availability_zones {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.436251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: dhcp-networks {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.437629 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: dhcp-agents {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.439016 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: routers {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.440923 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: flavors {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.442032 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: service_profiles {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.443206 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: next_providers {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.444713 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: service_profiles {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.446138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: floatingip-pools {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.447335 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: routers {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.449169 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: floatingips {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.450341 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: l3-routers {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.451678 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: l3-agents {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.453080 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: metering-labels {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.454530 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: metering-label-rules {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.455801 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: network-ip-availabilities {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.457029 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: bindings {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.458655 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: quotas {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.460064 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: quotas {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.461466 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: rbac-policies {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.462721 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: security-groups {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.464436 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: security-group-rules {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.465668 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: service-providers {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.466857 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: subnetpools {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.468273 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: subnetpools {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.469749 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.471402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.473199 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.474923 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.477689 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.479488 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.481764 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.595174 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.596975 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.598773 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron.api.extensions [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Extended resource: tags {{(pid=91540) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 20 20:18:53.605133 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING keystonemiddleware.auth_token [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 20:18:53.609955 dv-cinder-784623-13-iscsi neutron-server[91540]: WARNING keystonemiddleware.auth_token [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 20:18:53.618033 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_concurrency.lockutils [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Acquired lock "singleton_lock" {{(pid=91540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 20 20:18:53.618507 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_concurrency.lockutils [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Releasing lock "singleton_lock" {{(pid=91540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 20 20:18:53.619133 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO oslo_service.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Starting 2 workers May 20 20:18:53.623847 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Started child 91645 {{(pid=91540) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 20 20:18:53.628013 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Started child 91646 {{(pid=91540) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 20 20:18:53.628997 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:18:53.629644 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO neutron.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Neutron service started, listening on 0.0.0.0:9696 May 20 20:18:53.630188 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Notify callbacks [] for process, before_spawn {{(pid=91540) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:18:53.630445 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [-] (91645) wsgi starting up on http://0.0.0.0:9696 May 20 20:18:53.632724 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO oslo_service.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Starting 1 workers May 20 20:18:53.633206 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:18:53.634670 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [-] (91646) wsgi starting up on http://0.0.0.0:9696 May 20 20:18:53.638147 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Started child 91647 {{(pid=91540) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 20 20:18:53.638666 dv-cinder-784623-13-iscsi neutron-server[91540]: INFO oslo_service.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Starting 1 workers May 20 20:18:53.641928 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] calling RpcWorker wait() {{(pid=91647) _wait /opt/stack/neutron/neutron/service.py:128}} May 20 20:18:53.642508 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] returning from RpcWorker wait() {{(pid=91647) _wait /opt/stack/neutron/neutron/service.py:135}} May 20 20:18:53.642871 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Started child 91648 {{(pid=91540) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 20 20:18:53.643644 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG neutron_lib.callbacks.manager [None req-5e005036-7ea0-4a6c-a8f0-7a524bf3ca88 None None] Notify callbacks [] for process, after_spawn {{(pid=91540) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:18:53.643736 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:18:53.644142 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:18:53.645596 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91540) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 20 20:18:53.645807 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 20 20:18:53.645996 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 20 20:18:53.646206 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 20 20:18:53.646554 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 20 20:18:53.646720 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 20 20:18:53.647233 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.647514 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.647788 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.648052 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.648338 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.648735 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:18:53.649201 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.649201 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.649392 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.649654 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.649884 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:18:53.649987 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.650065 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.650203 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.650548 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.651103 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.651103 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.652518 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.652518 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.652518 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.652518 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.654179 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config_source = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.654179 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.654179 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.654179 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] debug = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.654179 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655166 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655166 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655166 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655166 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655166 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655494 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655674 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.655979 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.656128 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.656402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.656542 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.656775 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.657001 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.657234 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.657462 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.657673 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.658168 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] host = dv-cinder-784623-13-iscsi {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.658404 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.658596 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.658844 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.659123 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.659326 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.659536 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.659870 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.660115 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.660364 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.660791 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.660936 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.661062 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.661283 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_dir = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.661518 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.661683 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_options = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.661913 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.662181 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.662442 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.662627 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.662791 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.662962 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.663221 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.663381 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.663635 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.663871 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.664079 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.664309 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.664536 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.664764 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.665021 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.665251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.665491 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.665713 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.665973 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.666211 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.666480 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.666647 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.666879 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.667165 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.667407 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.667608 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.667917 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.668180 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.668391 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.668628 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.668861 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.669100 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.669348 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.669558 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.669779 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.670001 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.670230 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.670494 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.670718 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.672024 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.672854 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.672854 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.672854 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.673448 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.673448 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_journal = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.673726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_json = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.673726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.673988 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.674154 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.674360 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.674711 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.674996 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.675261 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.675500 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.676435 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.676435 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.678251 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.682465 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.683661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.685138 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.686726 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.688076 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.689322 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.689322 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.689322 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.689322 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.689322 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.690986 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.692787 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.692787 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.692787 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.692787 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.692787 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.692787 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.692787 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694577 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694577 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.694803 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.695084 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.695240 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.695490 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.695797 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.696144 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697175 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697175 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697175 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697175 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697175 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697514 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697590 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.697878 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.698145 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.698923 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.699447 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.699534 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.699701 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.699967 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.700184 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.700456 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.700693 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.700940 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.701181 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.701446 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.701703 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.701950 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.702204 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.702445 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.702720 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.702970 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.703250 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.703480 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.703736 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.704747 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.704747 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.704747 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.705073 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.705073 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.705319 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.705478 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.705720 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.705944 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.706206 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.706442 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.706717 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.706976 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.707203 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.707393 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.707622 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.707966 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.708191 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.708422 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.708632 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.708904 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.709164 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.709396 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.709669 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.709913 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.710162 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.710409 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.710638 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.710842 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.711049 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.711298 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.711504 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.711739 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.711985 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.712216 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.712448 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.712894 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.712894 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.713086 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.713286 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.713496 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.713713 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.713921 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.714759 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.714969 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.715186 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.715468 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.715619 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.715863 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.716075 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.716286 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.716547 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.716757 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.717020 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.717264 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.717492 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.717717 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.717950 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.718222 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.718431 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.718665 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.718876 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.719091 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.719300 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.719510 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.719735 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.719964 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.720211 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.720421 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.720668 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.720910 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.721240 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.721482 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.721705 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.721941 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.722150 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.722502 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.722654 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.722783 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.723012 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.723243 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.723453 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.723718 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.724057 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.724473 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.724617 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.724829 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.725029 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.726247 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.726247 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.726247 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.726247 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.726762 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.726762 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.726762 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.727133 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.727133 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.727361 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.728401 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.728401 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.728401 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.728401 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.728935 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.728935 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.729161 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.729287 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.729412 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.729663 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.730067 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.730067 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.730067 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.730704 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.730900 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.731072 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.731288 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.731596 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.731858 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.732078 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.732358 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.732760 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.733008 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.733268 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.733593 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.733803 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.734058 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.734296 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.734550 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.734778 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.735047 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.735363 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.735656 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.735903 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.736156 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.736434 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.736711 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.736974 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.737190 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.737507 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.737830 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.738101 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.738370 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.738593 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.738862 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.739102 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.739316 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.739531 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.739789 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.739992 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.740252 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.740475 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.740716 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.740931 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.741168 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.741386 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.741625 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.741842 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.742079 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.742290 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.742443 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 20 20:18:53.743023 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91540) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 20 20:18:53.743182 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 20 20:18:53.743331 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 20 20:18:53.743513 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 20 20:18:53.743684 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 20 20:18:53.743839 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 20 20:18:53.744046 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.744192 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.744347 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.744500 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.744653 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.744844 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.745001 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.745153 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.745430 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.745596 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.745736 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.745892 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.746029 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.746184 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.746337 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.746494 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.746685 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.746828 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.746971 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.747113 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] config_source = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.747248 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.747521 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.747677 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] debug = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.747849 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.748101 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.748227 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.748336 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.748487 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.748617 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.748797 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.748926 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.749058 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.749182 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.749342 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.749501 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.749628 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.749761 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.749887 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.750036 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.750188 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.750340 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] host = dv-cinder-784623-13-iscsi {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.750492 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.750643 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.750796 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.750949 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.751085 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.751241 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.751393 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.751546 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.751697 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.751869 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.752022 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.752174 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.752326 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_dir = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.752464 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.752618 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_options = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.752770 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.752923 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.753075 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.753245 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.753402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.753555 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.753762 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.753890 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.754015 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.754137 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.754259 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.754453 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.754634 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.754789 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.754944 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.755079 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.755237 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.755389 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.755541 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.755693 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.755866 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.756019 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.756173 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.756327 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.756480 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.756621 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.756815 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.756945 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.757069 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.757192 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.757334 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.757489 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.757640 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.757777 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.757934 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.758088 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.758224 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.758466 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.758627 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.758779 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.758931 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.759083 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.759239 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.759391 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.759542 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_journal = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.759696 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_json = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.760221 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.760221 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.760221 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.760578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.760578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.760578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.762158 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.762158 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 20:18:53.762158 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.762158 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.762158 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.762658 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.762658 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.762658 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.762658 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763039 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763039 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763180 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763255 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763384 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763679 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763679 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.763931 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.764136 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.764136 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.764524 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.764524 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.764764 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.764764 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.764995 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.765121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.765244 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.765378 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.765503 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.765626 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.765748 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.765870 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.766032 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.766189 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.766345 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.766501 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.766658 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.766817 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767011 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767192 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767333 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767471 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767650 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767845 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767996 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.767996 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.768365 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.768365 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.769620 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.770786 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.772578 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.773809 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.774826 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.776121 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777146 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777146 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777146 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777146 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777146 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777421 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777485 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.777662 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.778073 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.778073 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.778254 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.778334 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.778472 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779429 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779429 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779429 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779429 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779429 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779429 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779874 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779874 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.779874 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.780101 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.780180 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.780283 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.780418 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:18:53.780525 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.780608 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.780728 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.780883 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.781038 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.781194 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.781355 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.781523 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.781678 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.781834 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.781989 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.782165 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.782320 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.782476 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.782630 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.782783 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.782937 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.783092 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.783249 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.783406 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.783561 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.783715 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.783893 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.784053 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.784203 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.784359 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.784514 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.784672 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.784829 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.784984 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.785139 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.785296 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.785451 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.785605 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.785761 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.785916 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.786071 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.786227 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.786382 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.786537 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.786693 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.786849 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.787003 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.787153 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.787337 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.787442 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.787601 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.787755 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.787941 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.788096 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.788253 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.788408 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.788564 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.788721 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.788877 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.789037 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.789195 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.789337 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.789493 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.789647 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.789803 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.789963 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.790118 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.790274 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.790428 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.790601 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.790770 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.790925 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.791080 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.791235 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.791390 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.791661 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.791909 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.792700 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.792700 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.792700 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.792700 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.792700 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.793731 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.793731 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.793731 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.793731 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.793731 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.793731 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.793731 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.794707 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.794707 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.794707 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.794707 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.794707 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.794707 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.795402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.795402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.795402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.795402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.795402 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796173 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796173 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796173 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796173 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796173 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796732 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796732 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796732 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.796732 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.797108 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.797108 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.797565 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.797565 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.797858 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.797858 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.798075 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.798197 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.798328 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.798451 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.798577 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.798734 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.798940 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.799074 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.799197 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.799339 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.799494 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.799650 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.799828 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.799995 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.800161 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.800323 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.800479 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.800643 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.800806 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.800969 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.801124 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.801286 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.801454 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.801609 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.801764 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.801918 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.802072 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.802228 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.802383 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.802538 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.802695 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.802851 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.803005 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.803160 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.803317 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.803474 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.803630 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.803803 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.803962 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.804116 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.804272 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.804426 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 20:18:53.804565 dv-cinder-784623-13-iscsi neutron-server[91540]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 20 20:18:53.932138 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33446) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:18:53.940651 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [-] 10.222.0.82 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0062902 May 20 20:19:04.805897 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab113c6c-9949-4685-9675-9c6b520764f4 None None] get_active_networks_info from dv-cinder-784623-13-iscsi {{(pid=91647) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} May 20 20:19:04.916371 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab113c6c-9949-4685-9675-9c6b520764f4 None None] No non-hosted networks {{(pid=91647) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} May 20 20:19:04.928173 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.agentschedulers_db [None req-ab113c6c-9949-4685-9675-9c6b520764f4 None None] DHCP Agent not found on host dv-cinder-784623-13-iscsi {{(pid=91647) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} May 20 20:19:04.983811 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-cb40ed4e-15f3-4d13-a4bd-9eac574a495a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020'] for agent, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:07.153463 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020'] for agent, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:07.155567 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.156535 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.157315 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.157920 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.158727 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.159191 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.159986 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.160616 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.161264 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.161930 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.162548 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.163197 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:07.163897 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-784623-13-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:07.179715 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-784623-13-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:07.439471 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3e2eeb91-dd6a-4789-8f11-0a5e92ce1f39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020'] for agent, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:07.480979 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-891df158-4a12-4e25-8433-9ffcaf560c56 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:08.262908 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020'] for agent, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:09.852047 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020'] for agent, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:11.455670 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.db.l3_hamode_db [None req-5d0c570e-d967-42c9-8d24-4ef91c99caf6 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 May 20 20:19:11.540299 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d0c570e-d967-42c9-8d24-4ef91c99caf6 None None] Routers set() bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:19:11.540739 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d0c570e-d967-42c9-8d24-4ef91c99caf6 None None] Router IDs set() for agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} May 20 20:19:11.561666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33536) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:12.141325 dv-cinder-784623-13-iscsi neutron-server[91646]: WARNING oslo_policy.policy [None req-634e9755-f3ae-4ef9-879b-b7784d3303aa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:12.141926 dv-cinder-784623-13-iscsi neutron-server[91646]: WARNING oslo_policy.policy [None req-634e9755-f3ae-4ef9-879b-b7784d3303aa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:12.365500 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [None req-634e9755-f3ae-4ef9-879b-b7784d3303aa admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:19:12.366561 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-634e9755-f3ae-4ef9-879b-b7784d3303aa admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.8040142 May 20 20:19:14.744460 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33550) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:15.113621 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'default_prefixlen': 26, 'shared': True}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:19:15.212708 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.policy [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91646) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 20 20:19:15.257965 dv-cinder-784623-13-iscsi neutron-server[91646]: WARNING oslo_policy.policy [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:15.258324 dv-cinder-784623-13-iscsi neutron-server[91646]: WARNING oslo_policy.policy [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:15.267269 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.quota [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] Loaded quota_driver: . May 20 20:19:15.282119 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:15.342509 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8742249037150', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8742249036649', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8742249006854', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8742249017938', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8742248995029', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8742249000968', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-16452964', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16029093', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-324739', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-491781'] for rbac-policy, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:15.406399 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:15.407620 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-43f74dc7-dd33-41f3-bb03-16bc16280e0a admin admin] 10.222.0.82 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6615036 May 20 20:19:17.975728 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33564) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:18.330678 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Request body: {'network': {'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'name': 'private', 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:19:18.335396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:18.340530 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Usage tracker for resource:network and tenant:7fcd4bb05ae34fe19536c8095502022a is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:19:18.345068 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:19:18.351233 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:19:18.364106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Made reservation on behalf of 7fcd4bb05ae34fe19536c8095502022a for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:19:18.366913 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.383900 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.397973 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:18.402234 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Usage tracker for resource:security_group_rule and tenant:7fcd4bb05ae34fe19536c8095502022a is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:19:18.407154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:19:18.412692 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:19:18.507793 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.512015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.517398 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:18.537125 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] vlan segment allocate from pool success with {'vlan_id': 831, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:19:18.561113 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8742246099002', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.561726 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Unsubscribe: segment precommit_create {{(pid=91646) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 20 20:19:18.562176 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Added segment 2b48637b-31bd-4ac7-8d15-5921b4424e96 of type vlan for network d63f045c-0da4-4d29-8cf2-c09bd71f119c May 20 20:19:18.570202 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf851c78-6507-4a8c-abb4-5b43815fac53,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:18.623520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.623884 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.624210 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.624520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.624827 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.625147 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.625454 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.625764 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.626074 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.626371 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.626666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.626959 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Tracked resource versions report: May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: pushed versions: May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: { 'AddressGroup': {'1.2'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'ConntrackHelper': {'1.0'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Log': {'1.0'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Network': {'1.1'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Port': {'1.7'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'PortForwarding': {'1.2'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'QosPolicy': {'1.8'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroup': {'1.4'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroupRule': {'1.2'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SubPort': {'1.0'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Subnet': {'1.1'}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Trunk': {'1.1'}} May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: consumer versions: May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'ConntrackHelper': '1.0', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Log': '1.0', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Network': '1.1', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Port': '1.7', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'PortForwarding': '1.2', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'QosPolicy': '1.8', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroup': '1.4', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroupRule': '1.2', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SubPort': '1.0', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Subnet': '1.1', May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Trunk': '1.1'}} May 20 20:19:18.628287 dv-cinder-784623-13-iscsi neutron-server[91646]: {{(pid=91646) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:19:18.676901 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:18.678541 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.720730 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.722113 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:18.722762 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:18.727114 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:18.821290 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8443599 May 20 20:19:18.829842 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Pushing event updated for resources: {'Network': ['ID=d63f045c-0da4-4d29-8cf2-c09bd71f119c,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:18.833153 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:18.842199 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:19:21.462778 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33580) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:21.915531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-517156b7-968a-4708-9b66-2e7911a92540 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:21.917904 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-517156b7-968a-4708-9b66-2e7911a92540 admin admin] 10.222.0.82 "GET /v2.0/networks/d63f045c-0da4-4d29-8cf2-c09bd71f119c HTTP/1.1" status: 200 len: 825 time: 0.4537566 May 20 20:19:21.944344 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-edab76d8-fcd1-480f-946c-4a07af019247 admin admin] 10.222.0.82 "GET /v2.0/subnetpools/b3d580e7-c620-4ef7-86ce-37ac9f18f3ec HTTP/1.1" status: 200 len: 734 time: 0.0209141 May 20 20:19:21.953175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Request body: {'subnet': {'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'subnetpool_id': 'b3d580e7-c620-4ef7-86ce-37ac9f18f3ec', 'name': 'private-subnet', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'gateway_ip': '172.20.0.1', 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:19:21.957561 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:21.961256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Usage tracker for resource:subnet and tenant:7fcd4bb05ae34fe19536c8095502022a is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:19:21.964870 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:19:21.970395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:19:21.980779 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Made reservation on behalf of 7fcd4bb05ae34fe19536c8095502022a for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:19:21.983047 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:22.463051 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:22.468719 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:22.549608 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Checking segment: {'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:19:22.549979 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Network hostable DHCP agents. Network: d63f045c-0da4-4d29-8cf2-c09bd71f119c, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:19:22.553572 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b03e8db1-d520-46b4-a887-71c7dcf48b0b,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:22.559987 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:22.571913 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:19:22.582213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, d63f045c-0da4-4d29-8cf2-c09bd71f119c) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:19:22.586742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:22.587320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:22.591883 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba5f609f-9017-4c47-a931-90e87f9a901e None None] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:19:22.607157 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.6571717 May 20 20:19:22.897561 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-d63f045c-0da4-4d29-8cf2-c09bd71f119c', 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'fixed_ips': [{'subnet_id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:19:22.898710 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:23.085749 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Allocated IP 172.20.0.2 (d63f045c-0da4-4d29-8cf2-c09bd71f119c/b03e8db1-d520-46b4-a887-71c7dcf48b0b/183aea7a-f636-406d-b891-d52d8470df63) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:19:23.317060 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:23.330496 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Transition to ACTIVE for port object 183aea7a-f636-406d-b891-d52d8470df63 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:19:23.352415 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Transition to ACTIVE for port object 183aea7a-f636-406d-b891-d52d8470df63 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:19:23.359237 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:23.365876 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:23.427203 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:19:23.430036 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:19:23.437230 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Pushing event updated for resources: {'Port': ['ID=183aea7a-f636-406d-b891-d52d8470df63,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:23.439477 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:19:23.475520 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.475899 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.476230 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.476550 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.476868 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.477185 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.477497 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.477812 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.478143 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.478456 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.478786 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.479097 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Tracked resource versions report: May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: pushed versions: May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: { 'AddressGroup': {'1.2'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'ConntrackHelper': {'1.0'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Log': {'1.0'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Network': {'1.1'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Port': {'1.7'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'PortForwarding': {'1.2'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'QosPolicy': {'1.8'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroup': {'1.4'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroupRule': {'1.2'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SubPort': {'1.0'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Subnet': {'1.1'}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Trunk': {'1.1'}} May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: consumer versions: May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'ConntrackHelper': '1.0', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Log': '1.0', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Network': '1.1', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Port': '1.7', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'PortForwarding': '1.2', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'QosPolicy': '1.8', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroup': '1.4', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroupRule': '1.2', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SubPort': '1.0', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Subnet': '1.1', May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Trunk': '1.1'}} May 20 20:19:23.480488 dv-cinder-784623-13-iscsi neutron-server[91647]: {{(pid=91647) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:19:23.488224 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:23.542442 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Attempting to bind port 183aea7a-f636-406d-b891-d52d8470df63 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:19:23.542836 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Attempting to bind port 183aea7a-f636-406d-b891-d52d8470df63 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:19:23.543264 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Attempting to bind port 183aea7a-f636-406d-b891-d52d8470df63 on network d63f045c-0da4-4d29-8cf2-c09bd71f119c {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:19:23.548819 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 19, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:19:23.549231 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Checking segment: {'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:19:23.549730 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:23.550106 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Bound using segment: {'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:19:23.550566 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Bound port: 183aea7a-f636-406d-b891-d52d8470df63, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:19:23.550935 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:23.642180 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] For port 183aea7a-f636-406d-b891-d52d8470df63, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:19:23.646337 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] For port 183aea7a-f636-406d-b891-d52d8470df63, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=183aea7a-f636-406d-b891-d52d8470df63,segment=NetworkSegment(2b48637b-31bd-4ac7-8d15-5921b4424e96),segment_id=2b48637b-31bd-4ac7-8d15-5921b4424e96)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:19:23.650143 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:23.654280 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:23.742560 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Pushing event updated for resources: {'Port': ['ID=183aea7a-f636-406d-b891-d52d8470df63,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:23.746503 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:24.990206 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33590) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:25.368932 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [None req-0111c151-ea0d-46a7-95c7-70e28b1bfd47 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:19:25.371114 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-0111c151-ea0d-46a7-95c7-70e28b1bfd47 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3799615 May 20 20:19:27.728887 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33600) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:28.114862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [None req-fc51cb45-98ca-49fa-b7e9-b645440d1ba3 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:19:28.128778 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fc51cb45-98ca-49fa-b7e9-b645440d1ba3 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3986280 May 20 20:19:29.082932 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 183aea7a-f636-406d-b891-d52d8470df63 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:19:29.158641 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 183aea7a-f636-406d-b891-d52d8470df63 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:19:29.281036 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94d16953-e0ae-4580-84e3-0681b6891c1e None None] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:19:29.367482 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Provisioning for port 183aea7a-f636-406d-b891-d52d8470df63 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:19:29.382847 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Provisioning complete for port 183aea7a-f636-406d-b891-d52d8470df63 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:29.383244 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:29.579558 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:29.658432 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] For port 183aea7a-f636-406d-b891-d52d8470df63, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=183aea7a-f636-406d-b891-d52d8470df63,segment=NetworkSegment(2b48637b-31bd-4ac7-8d15-5921b4424e96),segment_id=2b48637b-31bd-4ac7-8d15-5921b4424e96)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:19:29.664021 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:29.667863 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:29.772259 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Pushing event updated for resources: {'Port': ['ID=183aea7a-f636-406d-b891-d52d8470df63,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:29.796714 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:29.987437 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-351236dd-e05b-4767-a282-76bdfd84fd2f None None] Provisioning complete for port 183aea7a-f636-406d-b891-d52d8470df63 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:29.987828 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-351236dd-e05b-4767-a282-76bdfd84fd2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:30.799071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33618) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:31.067941 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 183aea7a-f636-406d-b891-d52d8470df63 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:19:31.135082 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 183aea7a-f636-406d-b891-d52d8470df63 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:31.135450 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:31.155337 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Request body: {'router': {'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True, 'name': 'router1'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:19:31.160319 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:31.164268 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Usage tracker for resource:router and tenant:7fcd4bb05ae34fe19536c8095502022a is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:19:31.168750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:19:31.174983 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:19:31.185605 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:31.187285 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:31.208660 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:31.315751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:31.333395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:31.334765 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-23add21a-da4c-4b13-8557-7b098be71311 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5345998 May 20 20:19:33.648560 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33628) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:34.022492 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [None req-2f47a3dd-7418-4f19-829b-d91da022ee88 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:19:34.023578 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-2f47a3dd-7418-4f19-829b-d91da022ee88 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3740716 May 20 20:19:34.729698 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4ca5833b-42d3-4fa3-9489-69e41ac9205d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:36.387351 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33638) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:36.752262 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Request body: {'network': {'is_default': True, 'name': 'public', 'router:external': True, 'admin_state_up': True, 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:19:36.757136 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:36.761697 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Usage tracker for resource:network and tenant:ae3ef8186a5d4502b06446d1c8569419 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:19:36.764510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:19:36.770218 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:19:36.779596 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Made reservation on behalf of ae3ef8186a5d4502b06446d1c8569419 for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:19:36.781880 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:36.793374 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:36.807817 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:36.811437 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Usage tracker for resource:security_group_rule and tenant:ae3ef8186a5d4502b06446d1c8569419 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:19:36.814130 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:19:36.819680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:19:36.904837 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:36.908813 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:36.912809 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:36.928101 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Reserving flat network on physical network physnet1 {{(pid=91646) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} May 20 20:19:36.948354 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba7d3b45-a707-4f25-980d-5af9a9423389,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:36.952404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:36.953326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:36.953659 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Added segment e154b7e6-c550-4790-a468-97d736bc8feb of type flat for network 86a15d61-a97a-4109-a08b-ca9231f239f9 May 20 20:19:36.986572 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:37.021983 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:37.023324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:37.023934 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:37.028966 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:37.120345 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7318890 May 20 20:19:37.128275 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Pushing event updated for resources: {'Network': ['ID=86a15d61-a97a-4109-a08b-ca9231f239f9,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:37.133806 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:37.145899 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:19:37.169752 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:37.436519 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-cdfb09d7-1ae7-4c86-a93f-06f8920c7778 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:38.195834 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:39.474947 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33658) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:39.683867 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-143fa8fc-c555-4af7-9622-ab7beba1e584 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:39.685174 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-143fa8fc-c555-4af7-9622-ab7beba1e584 admin admin] 10.222.0.82 "GET /v2.0/subnets/b03e8db1-d520-46b4-a887-71c7dcf48b0b HTTP/1.1" status: 200 len: 849 time: 0.2092688 May 20 20:19:39.801113 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:39.829483 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fd59e782-bdc1-4806-9811-c94c8a0d0547 admin admin] 10.222.0.82 "GET /v2.0/routers/6a495f43-3990-4d45-a30a-5441fa6264a5 HTTP/1.1" status: 200 len: 704 time: 0.1388488 May 20 20:19:40.318109 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:40.542734 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Allocated IP 172.20.0.1 (d63f045c-0da4-4d29-8cf2-c09bd71f119c/b03e8db1-d520-46b4-a887-71c7dcf48b0b/a1e25870-1737-45fa-8b5b-ae0e522998d5) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:19:40.699524 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:40.716212 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Transition to ACTIVE for port object a1e25870-1737-45fa-8b5b-ae0e522998d5 will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:19:40.768891 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:40.773339 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:40.832476 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:19:40.835223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:19:40.839060 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:19:40.839563 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:40.966176 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Pushing event updated for resources: {'Port': ['ID=a1e25870-1737-45fa-8b5b-ae0e522998d5,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:40.975301 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:40.990191 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-3151ad71-d2e8-4720-b437-c5518f75f5fb None None] Provisioning for port a1e25870-1737-45fa-8b5b-ae0e522998d5 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:19:40.995443 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-3151ad71-d2e8-4720-b437-c5518f75f5fb None None] Provisioning complete for port a1e25870-1737-45fa-8b5b-ae0e522998d5 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:40.995839 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3151ad71-d2e8-4720-b437-c5518f75f5fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:41.053884 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-3151ad71-d2e8-4720-b437-c5518f75f5fb None None] Port a1e25870-1737-45fa-8b5b-ae0e522998d5 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:19:41.097519 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:41.321513 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:41.326771 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:41.327931 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:41.331852 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:41.426583 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Pushing event updated for resources: {'Port': ['ID=a1e25870-1737-45fa-8b5b-ae0e522998d5,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:41.470659 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:41.524897 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:19:41.526474 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:19:41.676379 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-f1a476f6-73d8-41d5-8741-b0e9913e1ea6 None None] Provisioning complete for port a1e25870-1737-45fa-8b5b-ae0e522998d5 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:41.676787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-f1a476f6-73d8-41d5-8741-b0e9913e1ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:41.727578 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-f1a476f6-73d8-41d5-8741-b0e9913e1ea6 None None] Port a1e25870-1737-45fa-8b5b-ae0e522998d5 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:19:41.755594 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Router 6a495f43-3990-4d45-a30a-5441fa6264a5 is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91646) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:19:41.908938 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:19:41.918469 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] 10.222.0.82 "PUT /v2.0/routers/6a495f43-3990-4d45-a30a-5441fa6264a5/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0840111 May 20 20:19:41.919669 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Sync routers for ids ['6a495f43-3990-4d45-a30a-5441fa6264a5'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:19:41.930346 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Routers {'6a495f43-3990-4d45-a30a-5441fa6264a5'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:19:41.931110 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:19:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['6a495f43-3990-4d45-a30a-5441fa6264a5'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:42.105154 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Set router 6a495f43-3990-4d45-a30a-5441fa6264a5 gateway port host: None {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:19:42.473733 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'name': 'router1', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:19:31Z', 'updated_at': '2021-05-20T20:19:41Z', 'revision_number': 2, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'gw_port_host': None, '_interfaces': [{'id': 'a1e25870-1737-45fa-8b5b-ae0e522998d5', 'name': '', 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'mac_address': 'fa:16:3e:6c:dc:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:40Z', 'updated_at': '2021-05-20T20:19:41Z', 'revision_number': 2, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'subnets': [{'id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'b3d580e7-c620-4ef7-86ce-37ac9f18f3ec'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:42.478784 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Checking router: 6a495f43-3990-4d45-a30a-5441fa6264a5 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:19:42.479076 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Updating router 6a495f43-3990-4d45-a30a-5441fa6264a5 port a1e25870-1737-45fa-8b5b-ae0e522998d5 binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:19:42.530208 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:42.901686 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:42.917425 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Transition to ACTIVE for port object a1e25870-1737-45fa-8b5b-ae0e522998d5 will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:19:42.924606 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:42.930601 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:43.098988 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Pushing event updated for resources: {'Port': ['ID=a1e25870-1737-45fa-8b5b-ae0e522998d5,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:43.141288 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.141625 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.141957 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.142807 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.142807 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.143720 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.144132 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.144463 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.144922 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.145247 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.145560 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.145870 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Tracked resource versions report: May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: pushed versions: May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: { 'AddressGroup': {'1.2'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'ConntrackHelper': {'1.0'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Log': {'1.0'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Network': {'1.1'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Port': {'1.7'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'PortForwarding': {'1.2'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'QosPolicy': {'1.8'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroup': {'1.4'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroupRule': {'1.2'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SubPort': {'1.0'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Subnet': {'1.1'}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Trunk': {'1.1'}} May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: consumer versions: May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'ConntrackHelper': '1.0', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Log': '1.0', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Network': '1.1', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Port': '1.7', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'PortForwarding': '1.2', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'QosPolicy': '1.8', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroup': '1.4', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroupRule': '1.2', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SubPort': '1.0', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Subnet': '1.1', May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Trunk': '1.1'}} May 20 20:19:43.147485 dv-cinder-784623-13-iscsi neutron-server[91648]: {{(pid=91648) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:19:43.162526 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:43.172888 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Attempting to bind port a1e25870-1737-45fa-8b5b-ae0e522998d5 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:19:43.173279 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Attempting to bind port a1e25870-1737-45fa-8b5b-ae0e522998d5 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:19:43.173711 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Attempting to bind port a1e25870-1737-45fa-8b5b-ae0e522998d5 on network d63f045c-0da4-4d29-8cf2-c09bd71f119c {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:19:43.179004 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 19, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:19:43.179402 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Checking segment: {'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:19:43.179931 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:43.180316 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Bound using segment: {'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:19:43.180818 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Bound port: a1e25870-1737-45fa-8b5b-ae0e522998d5, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2b48637b-31bd-4ac7-8d15-5921b4424e96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:19:43.181202 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:43.270281 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] For port a1e25870-1737-45fa-8b5b-ae0e522998d5, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:19:43.274320 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] For port a1e25870-1737-45fa-8b5b-ae0e522998d5, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=a1e25870-1737-45fa-8b5b-ae0e522998d5,segment=NetworkSegment(2b48637b-31bd-4ac7-8d15-5921b4424e96),segment_id=2b48637b-31bd-4ac7-8d15-5921b4424e96)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:19:43.279309 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:43.283884 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:43.395522 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Pushing event updated for resources: {'Port': ['ID=a1e25870-1737-45fa-8b5b-ae0e522998d5,revision_number=4']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:43.399066 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:43.399813 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Routers {'6a495f43-3990-4d45-a30a-5441fa6264a5'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:19:43.401095 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:19:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['6a495f43-3990-4d45-a30a-5441fa6264a5'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:43.559329 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] Set router 6a495f43-3990-4d45-a30a-5441fa6264a5 gateway port host: None {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:19:43.879619 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'name': 'router1', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:19:31Z', 'updated_at': '2021-05-20T20:19:41Z', 'revision_number': 2, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'gw_port_host': None, '_interfaces': [{'id': 'a1e25870-1737-45fa-8b5b-ae0e522998d5', 'name': '', 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'mac_address': 'fa:16:3e:6c:dc:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:40Z', 'updated_at': '2021-05-20T20:19:43Z', 'revision_number': 4, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'subnets': [{'id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'b3d580e7-c620-4ef7-86ce-37ac9f18f3ec'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:43.883466 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928d9231-bf32-4d40-b66c-179c42b7d3af None None] The sync data for ids ['6a495f43-3990-4d45-a30a-5441fa6264a5'] in dv-cinder-784623-13-iscsi is: [{'id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'name': 'router1', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:19:31Z', 'updated_at': '2021-05-20T20:19:41Z', 'revision_number': 2, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'gw_port_host': None, '_interfaces': [{'id': 'a1e25870-1737-45fa-8b5b-ae0e522998d5', 'name': '', 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'mac_address': 'fa:16:3e:6c:dc:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:40Z', 'updated_at': '2021-05-20T20:19:43Z', 'revision_number': 4, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'subnets': [{'id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'b3d580e7-c620-4ef7-86ce-37ac9f18f3ec'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:19:44.097750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 33680) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:44.243651 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e66fdf7-8c4c-4daa-ade8-217e4ac7bee0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:44.244270 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6e66fdf7-8c4c-4daa-ade8-217e4ac7bee0 admin admin] Synchronizing usage tracker for tenant:ae3ef8186a5d4502b06446d1c8569419 on resource:network {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:19:44.261961 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6e66fdf7-8c4c-4daa-ade8-217e4ac7bee0 admin admin] Unset dirty status for tenant:ae3ef8186a5d4502b06446d1c8569419 on resource:network {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:19:44.268202 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6e66fdf7-8c4c-4daa-ade8-217e4ac7bee0 admin admin] 10.222.0.82 "GET /v2.0/networks/86a15d61-a97a-4109-a08b-ca9231f239f9 HTTP/1.1" status: 200 len: 842 time: 0.1644301 May 20 20:19:44.272514 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Request body: {'subnet': {'enable_dhcp': False, 'cidr': '172.27.3.0/24', 'ip_version': 4, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'gateway_ip': '172.27.3.1', 'name': 'public-subnet'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:19:44.278253 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:19:44.282015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Usage tracker for resource:subnet and tenant:ae3ef8186a5d4502b06446d1c8569419 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:19:44.285148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:19:44.292226 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:19:44.301559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Made reservation on behalf of ae3ef8186a5d4502b06446d1c8569419 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:19:44.303925 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:44.717417 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.objects.ports [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=91646) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}} May 20 20:19:44.717840 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:44.721355 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-132a02d4-0466-4706-8771-d668a6a4dcf1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:44.792539 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a41fc833-05a5-4db1-8e8c-fa7fa38d3cea,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:44.796140 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:44.803124 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:19:44.803481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Network hostable DHCP agents. Network: 86a15d61-a97a-4109-a08b-ca9231f239f9, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:19:44.820135 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:19:44.830941 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 86a15d61-a97a-4109-a08b-ca9231f239f9) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:19:44.835705 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:44.839939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:44.840647 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8402eb8e-d6d4-43e6-b4e5-2731e0fd5a20 None None] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:19:44.871789 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5925796 May 20 20:19:45.049498 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f17ccd52-028f-4632-ac14-0a5cfe1bf6a3 None None] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:19:47.089440 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device a1e25870-1737-45fa-8b5b-ae0e522998d5 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:19:47.142540 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 33694) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:47.163606 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port a1e25870-1737-45fa-8b5b-ae0e522998d5 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:19:47.169058 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port a1e25870-1737-45fa-8b5b-ae0e522998d5 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:47.169431 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:47.288561 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:47.317320 dv-cinder-784623-13-iscsi neutron-server[91645]: WARNING oslo_policy.policy [None req-9991340b-e71c-4b3a-b295-4753308d6f43 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:47.317923 dv-cinder-784623-13-iscsi neutron-server[91645]: WARNING oslo_policy.policy [None req-9991340b-e71c-4b3a-b295-4753308d6f43 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:47.321635 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port a1e25870-1737-45fa-8b5b-ae0e522998d5, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=a1e25870-1737-45fa-8b5b-ae0e522998d5,segment=NetworkSegment(2b48637b-31bd-4ac7-8d15-5921b4424e96),segment_id=2b48637b-31bd-4ac7-8d15-5921b4424e96)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:19:47.326066 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:47.328239 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-43871c81-b961-4a2c-8f8b-d091f549692d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:47.399640 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=a1e25870-1737-45fa-8b5b-ae0e522998d5,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:47.403662 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:47.617592 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.policy [None req-9991340b-e71c-4b3a-b295-4753308d6f43 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91645) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 20 20:19:47.663774 dv-cinder-784623-13-iscsi neutron-server[91645]: WARNING oslo_policy.policy [None req-9991340b-e71c-4b3a-b295-4753308d6f43 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:47.664163 dv-cinder-784623-13-iscsi neutron-server[91645]: WARNING oslo_policy.policy [None req-9991340b-e71c-4b3a-b295-4753308d6f43 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 20 20:19:47.889105 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9991340b-e71c-4b3a-b295-4753308d6f43 admin admin] 10.222.0.82 "GET /v2.0/routers/6a495f43-3990-4d45-a30a-5441fa6264a5 HTTP/1.1" status: 200 len: 710 time: 0.7442102 May 20 20:19:48.050141 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-920fb6d6-b2cf-4031-be9f-6e4489d6fdad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:19:48.051832 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-920fb6d6-b2cf-4031-be9f-6e4489d6fdad admin admin] 10.222.0.82 "GET /v2.0/networks/86a15d61-a97a-4109-a08b-ca9231f239f9 HTTP/1.1" status: 200 len: 886 time: 0.1576481 May 20 20:19:48.061757 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:19:48.512208 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:48.843785 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:48.903587 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:49.045419 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Allocated IP 172.27.3.169 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/b7b2faa0-71ed-41a7-b1c6-a28e9723cff3) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:19:49.072559 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device a1e25870-1737-45fa-8b5b-ae0e522998d5 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:19:49.140468 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port a1e25870-1737-45fa-8b5b-ae0e522998d5 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:49.140838 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:49.200962 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:49.261153 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:49.268135 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:49.314731 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:19:49.315883 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:19:49.368257 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:19:49.430079 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Pushing event updated for resources: {'Port': ['ID=b7b2faa0-71ed-41a7-b1c6-a28e9723cff3,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:49.488433 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.488772 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.489095 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.489411 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.489725 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.490039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.490357 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.490675 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.490983 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.491283 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.491582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.491908 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Tracked resource versions report: May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: pushed versions: May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: { 'AddressGroup': {'1.2'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'ConntrackHelper': {'1.0'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Log': {'1.0'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Network': {'1.1'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Port': {'1.7'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'PortForwarding': {'1.2'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'QosPolicy': {'1.8'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroup': {'1.4'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroupRule': {'1.2'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SubPort': {'1.0'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Subnet': {'1.1'}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Trunk': {'1.1'}} May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: consumer versions: May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'ConntrackHelper': '1.0', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Log': '1.0', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Network': '1.1', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Port': '1.7', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'PortForwarding': '1.2', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'QosPolicy': '1.8', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroup': '1.4', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroupRule': '1.2', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SubPort': '1.0', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Subnet': '1.1', May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Trunk': '1.1'}} May 20 20:19:49.493226 dv-cinder-784623-13-iscsi neutron-server[91645]: {{(pid=91645) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:19:49.512473 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:49.785714 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:50.121651 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:50.125090 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-662523', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-662445', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-735227'] for router, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:50.302785 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Router 6a495f43-3990-4d45-a30a-5441fa6264a5 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:19:50.472914 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:19:50.482375 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Sync routers for ids ['6a495f43-3990-4d45-a30a-5441fa6264a5'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:19:50.486804 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:50.488006 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] 10.222.0.82 "PUT /v2.0/routers/6a495f43-3990-4d45-a30a-5441fa6264a5 HTTP/1.1" status: 200 len: 890 time: 2.4297221 May 20 20:19:50.491679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Routers {'6a495f43-3990-4d45-a30a-5441fa6264a5'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:19:50.492332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:19:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['6a495f43-3990-4d45-a30a-5441fa6264a5'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:50.705305 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Set router 6a495f43-3990-4d45-a30a-5441fa6264a5 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:19:51.044971 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'name': 'router1', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': 'b7b2faa0-71ed-41a7-b1c6-a28e9723cff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:19:31Z', 'updated_at': '2021-05-20T20:19:49Z', 'revision_number': 4, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'gw_port': {'id': 'b7b2faa0-71ed-41a7-b1c6-a28e9723cff3', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:41:60:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:48Z', 'updated_at': '2021-05-20T20:19:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a1e25870-1737-45fa-8b5b-ae0e522998d5', 'name': '', 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'mac_address': 'fa:16:3e:6c:dc:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:40Z', 'updated_at': '2021-05-20T20:19:47Z', 'revision_number': 5, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'subnets': [{'id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'b3d580e7-c620-4ef7-86ce-37ac9f18f3ec'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:51.050075 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Checking router: 6a495f43-3990-4d45-a30a-5441fa6264a5 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:19:51.050417 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Updating router 6a495f43-3990-4d45-a30a-5441fa6264a5 port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:19:51.104041 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:51.434115 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:51.445106 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Transition to ACTIVE for port object b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:19:51.451343 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:51.454968 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:51.533030 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Attempting to bind port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:19:51.533690 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Attempting to bind port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:19:51.533819 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Attempting to bind port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:19:51.536981 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d81f6ab1-167c-479d-a326-fb35710983f8 None None] Pushing event updated for resources: {'Port': ['ID=b7b2faa0-71ed-41a7-b1c6-a28e9723cff3,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:51.540788 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-d81f6ab1-167c-479d-a326-fb35710983f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:51.544753 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 19, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:19:51.545130 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:19:51.545536 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:51.545919 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:19:51.546401 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Bound port: b7b2faa0-71ed-41a7-b1c6-a28e9723cff3, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:19:51.546780 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:51.617924 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] For port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:19:51.621883 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] For port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b7b2faa0-71ed-41a7-b1c6-a28e9723cff3,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:19:51.625511 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:51.629219 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:51.706744 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d81f6ab1-167c-479d-a326-fb35710983f8 None None] Pushing event updated for resources: {'Port': ['ID=b7b2faa0-71ed-41a7-b1c6-a28e9723cff3,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:51.710190 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-d81f6ab1-167c-479d-a326-fb35710983f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:51.710765 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Routers {'6a495f43-3990-4d45-a30a-5441fa6264a5'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:19:51.711342 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:19:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['6a495f43-3990-4d45-a30a-5441fa6264a5'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:51.887866 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] Set router 6a495f43-3990-4d45-a30a-5441fa6264a5 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:19:52.238891 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'name': 'router1', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': 'b7b2faa0-71ed-41a7-b1c6-a28e9723cff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:19:31Z', 'updated_at': '2021-05-20T20:19:49Z', 'revision_number': 4, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'gw_port': {'id': 'b7b2faa0-71ed-41a7-b1c6-a28e9723cff3', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:41:60:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:48Z', 'updated_at': '2021-05-20T20:19:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a1e25870-1737-45fa-8b5b-ae0e522998d5', 'name': '', 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'mac_address': 'fa:16:3e:6c:dc:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:40Z', 'updated_at': '2021-05-20T20:19:47Z', 'revision_number': 5, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'subnets': [{'id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'b3d580e7-c620-4ef7-86ce-37ac9f18f3ec'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:19:52.242800 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-485ced3f-0709-45b7-b4a1-8e912c87e170 None None] The sync data for ids ['6a495f43-3990-4d45-a30a-5441fa6264a5'] in dv-cinder-784623-13-iscsi is: [{'id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'name': 'router1', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': 'b7b2faa0-71ed-41a7-b1c6-a28e9723cff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:19:31Z', 'updated_at': '2021-05-20T20:19:49Z', 'revision_number': 4, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'gw_port': {'id': 'b7b2faa0-71ed-41a7-b1c6-a28e9723cff3', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:41:60:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:48Z', 'updated_at': '2021-05-20T20:19:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a1e25870-1737-45fa-8b5b-ae0e522998d5', 'name': '', 'network_id': 'd63f045c-0da4-4d29-8cf2-c09bd71f119c', 'tenant_id': '7fcd4bb05ae34fe19536c8095502022a', 'mac_address': 'fa:16:3e:6c:dc:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a495f43-3990-4d45-a30a-5441fa6264a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:19:40Z', 'updated_at': '2021-05-20T20:19:47Z', 'revision_number': 5, 'project_id': '7fcd4bb05ae34fe19536c8095502022a', 'subnets': [{'id': 'b03e8db1-d520-46b4-a887-71c7dcf48b0b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'b3d580e7-c620-4ef7-86ce-37ac9f18f3ec'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:19:52.856018 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 33714) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:19:52.975408 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-74be1f07-e09f-47f1-a1e5-40b257f79d8f admin admin] 10.222.0.82 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1182380 May 20 20:19:53.095673 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:19:53.165326 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:19:53.170876 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:53.171248 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:53.291932 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:53.308607 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b7b2faa0-71ed-41a7-b1c6-a28e9723cff3,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:19:53.312253 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:19:53.314765 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:19:53.384417 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=b7b2faa0-71ed-41a7-b1c6-a28e9723cff3,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:19:53.387651 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:19:55.086496 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:19:55.164401 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port b7b2faa0-71ed-41a7-b1c6-a28e9723cff3 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:19:55.164776 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:01.702990 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:20:04.733404 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ebfc769c-d57a-427f-b543-947bd19bb9ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:07.142144 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:07.452742 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-27cdff56-0a47-414e-bbaa-5be9e1635123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:08.213524 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:09.825241 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:34.739176 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b2b03a0e-ebce-4988-bd88-87595f83e87c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:37.148122 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:37.438192 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-59fcab54-b6be-405d-943a-1993a8b84673 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:38.199360 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:20:38.703004 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:20:39.821460 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:04.730737 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3351acca-f336-4e6e-99b5-4389a07a6540 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:07.141144 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:07.440608 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6eb00f50-13fc-4131-806e-c15fabea771a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:08.202850 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:09.824580 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:15.701726 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:21:27.775856 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34286) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:27.846022 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.pecan_wsgi.hooks.translation [None req-6d544bcf-be55-4e7e-85c2-d3d773c5251c admin admin] GET failed (client error): The resource could not be found. May 20 20:21:27.847308 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-6d544bcf-be55-4e7e-85c2-d3d773c5251c admin admin] 10.222.0.82 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0705130 May 20 20:21:27.979078 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07e9060a-07ab-4c2f-97f3-fbbbf7b84355 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:27.980487 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-07e9060a-07ab-4c2f-97f3-fbbbf7b84355 admin admin] 10.222.0.82 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1291885 May 20 20:21:30.105882 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34296) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:30.217261 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b4397ac-af2e-407d-8dc8-f50d9c3d7a98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:30.218590 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-0b4397ac-af2e-407d-8dc8-f50d9c3d7a98 admin admin] 10.222.0.82 "GET /v2.0/subnets/b03e8db1-d520-46b4-a887-71c7dcf48b0b HTTP/1.1" status: 200 len: 849 time: 0.1117830 May 20 20:21:30.228984 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:21:30.342222 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Notify callbacks [] for subnet, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:30.530133 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8742246071233'] for subnet, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:30.534696 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:21:30.606919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:30.607423 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:30.608718 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] 10.222.0.82 "PUT /v2.0/subnets/b03e8db1-d520-46b4-a887-71c7dcf48b0b HTTP/1.1" status: 200 len: 868 time: 0.3842773 May 20 20:21:30.626951 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c43a65b-2449-4757-a040-5ed9ae97a57e None None] Network d63f045c-0da4-4d29-8cf2-c09bd71f119c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:21:30.636978 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Pushing event updated for resources: {'Subnet': ['ID=b03e8db1-d520-46b4-a887-71c7dcf48b0b,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:21:30.644880 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.645218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.645541 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.645860 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.646176 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.646493 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.646806 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.647848 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.648381 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.648703 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.649021 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.649336 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:21:30.653963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:21:31.072539 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-c0308f9f-c7dc-45fe-91ea-a5b3952208cd None None] Provisioning complete for port a1e25870-1737-45fa-8b5b-ae0e522998d5 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:21:31.072906 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c0308f9f-c7dc-45fe-91ea-a5b3952208cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:31.200078 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-c0308f9f-c7dc-45fe-91ea-a5b3952208cd None None] Provisioning complete for port 183aea7a-f636-406d-b891-d52d8470df63 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:21:31.200341 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c0308f9f-c7dc-45fe-91ea-a5b3952208cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:32.717253 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34306) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:32.895654 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3259545-99fd-4c86-aef1-3a028ab4d98c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:32.896059 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3259545-99fd-4c86-aef1-3a028ab4d98c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:32.898576 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a3259545-99fd-4c86-aef1-3a028ab4d98c admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1803801 May 20 20:21:34.732050 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-67de5a9f-b1e9-45bd-88fe-272da5a108c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:35.007869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34316) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:35.178669 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-235eb293-a919-4b43-b699-dfbb1a090f80 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:35.179140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-235eb293-a919-4b43-b699-dfbb1a090f80 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:35.180667 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-235eb293-a919-4b43-b699-dfbb1a090f80 admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1718783 May 20 20:21:37.144512 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:37.291517 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34326) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:37.443070 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a91513f2-dfc1-4ea6-8532-a75fb1cd9139 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:37.461736 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ee5c790-ea30-44ae-9a66-9297ce877d0d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:37.463092 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4ee5c790-ea30-44ae-9a66-9297ce877d0d admin admin] 10.222.0.82 "GET /v2.0/networks/86a15d61-a97a-4109-a08b-ca9231f239f9 HTTP/1.1" status: 200 len: 886 time: 0.1706157 May 20 20:21:38.210857 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:39.589289 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34336) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:39.761929 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ede46c4-24f9-4dc0-8429-d3dc7aef212a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:39.763591 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-2ede46c4-24f9-4dc0-8429-d3dc7aef212a admin admin] 10.222.0.82 "GET /v2.0/networks/d63f045c-0da4-4d29-8cf2-c09bd71f119c HTTP/1.1" status: 200 len: 869 time: 0.1733587 May 20 20:21:39.832109 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:21:41.890136 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34346) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:41.997586 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56de2b6b-b734-4721-8614-8101d282e8c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:41.998042 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56de2b6b-b734-4721-8614-8101d282e8c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:41.998763 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-56de2b6b-b734-4721-8614-8101d282e8c3 admin admin] Synchronizing usage tracker for tenant:ae3ef8186a5d4502b06446d1c8569419 on resource:subnet {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:21:42.015090 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-56de2b6b-b734-4721-8614-8101d282e8c3 admin admin] Unset dirty status for tenant:ae3ef8186a5d4502b06446d1c8569419 on resource:subnet {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:21:42.016271 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-56de2b6b-b734-4721-8614-8101d282e8c3 admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1251256 May 20 20:21:44.144685 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34356) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:44.251312 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0906ca9b-9362-48ee-a177-28f6e2da9487 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:44.251773 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0906ca9b-9362-48ee-a177-28f6e2da9487 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:44.253264 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-0906ca9b-9362-48ee-a177-28f6e2da9487 admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1076477 May 20 20:21:46.375394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34366) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:46.521099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd88749f-c163-4ea2-8333-f098eb1020cc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:46.522876 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-bd88749f-c163-4ea2-8333-f098eb1020cc admin admin] 10.222.0.82 "GET /v2.0/subnets/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea HTTP/1.1" status: 200 len: 816 time: 0.1464338 May 20 20:21:48.676205 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34376) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:21:48.786506 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e375ec0-d26d-42c5-b284-2b0ad5197cf6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:21:48.788441 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4e375ec0-d26d-42c5-b284-2b0ad5197cf6 admin admin] 10.222.0.82 "GET /v2.0/subnets/b03e8db1-d520-46b4-a887-71c7dcf48b0b HTTP/1.1" status: 200 len: 868 time: 0.1113086 May 20 20:21:52.700642 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:22:04.740106 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-16819c7c-f935-4702-9b8b-cdab03d06839 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:07.146280 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:07.446215 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a08fe237-2b5c-4127-872d-895adc8a3017 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:08.213942 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:09.831657 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:12.084365 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34420) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:22:12.135406 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [None req-9bd93e40-71c8-4613-835d-81e89c18a8dc admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:22:12.136428 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-9bd93e40-71c8-4613-835d-81e89c18a8dc admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0510392 May 20 20:22:14.357530 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34430) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:22:14.425356 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.pecan_wsgi.hooks.translation [None req-d550599e-f387-4c1d-9c39-7a6fc9905b6f admin admin] GET failed (client error): The resource could not be found. May 20 20:22:14.426589 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d550599e-f387-4c1d-9c39-7a6fc9905b6f admin admin] 10.222.0.82 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0681009 May 20 20:22:14.547413 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df965480-e481-448c-b972-2441d739bd30 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:22:14.548781 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-df965480-e481-448c-b972-2441d739bd30 admin admin] 10.222.0.82 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1183167 May 20 20:22:16.682881 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34440) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:22:16.733311 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:22:16.734478 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.quota [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Loaded quota_driver: . May 20 20:22:16.740810 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:22:16.751420 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:22:16.763901 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Made reservation on behalf of ae3ef8186a5d4502b06446d1c8569419 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:22:16.766153 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:16.857724 dv-cinder-784623-13-iscsi neutron-server[91645]: WARNING neutron.services.revisions.revision_plugin [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Could not find related network for resource to bump revision. May 20 20:22:16.871355 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] vlan segment allocate from pool success with {'vlan_id': 827, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:22:16.883666 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8742246099002', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:16.884266 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Unsubscribe: segment precommit_create {{(pid=91645) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 20 20:22:16.884698 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Added segment 86f13d3e-0be6-42ff-b615-3d835f455446 of type vlan for network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 May 20 20:22:16.946851 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:16.980034 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:16.981451 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:22:16.982022 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:16.985886 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:22:17.084231 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4001541 May 20 20:22:17.084796 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Pushing event updated for resources: {'Network': ['ID=2b1283d5-cab9-4b45-879a-1d09bbf331c1,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:22:17.088063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:22:17.096125 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:22:19.285101 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34450) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:22:19.352893 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.pecan_wsgi.hooks.translation [None req-ae8933c9-a105-4eac-ab8b-f2a67c8c9a98 admin admin] GET failed (client error): The resource could not be found. May 20 20:22:19.354122 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ae8933c9-a105-4eac-ab8b-f2a67c8c9a98 admin admin] 10.222.0.82 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0674286 May 20 20:22:19.457104 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da2b11e1-814f-4fe5-8047-e0aec5cafdc8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:22:19.458977 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-da2b11e1-814f-4fe5-8047-e0aec5cafdc8 admin admin] 10.222.0.82 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1010602 May 20 20:22:19.468415 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'description': 'shared-subnet', 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1', 'name': 'shared-subnet', 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:22:19.472722 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:22:19.483244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:22:19.493429 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Made reservation on behalf of ae3ef8186a5d4502b06446d1c8569419 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:22:19.495643 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Notify callbacks [] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:19.865262 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:19.869613 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:22:19.940360 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Pushing event updated for resources: {'Subnet': ['ID=c3a7ac06-3392-4dcf-a75b-e9418337579c,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:22:19.951478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.951859 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.952199 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.952522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.952841 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.953182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.953504 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.953835 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.954170 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.954484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.954794 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.955106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:19.958010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Checking segment: {'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:22:19.958908 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Network hostable DHCP agents. Network: 2b1283d5-cab9-4b45-879a-1d09bbf331c1, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:22:19.961622 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:22:19.976033 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:22:19.984605 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 2b1283d5-cab9-4b45-879a-1d09bbf331c1) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:22:19.988710 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:22:19.989291 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:19.994235 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad12a0fb-5bf4-41e8-99bf-4762259b51cd None None] Network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:22:20.012863 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5478172 May 20 20:22:20.220019 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-2b1283d5-cab9-4b45-879a-1d09bbf331c1', 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1', 'tenant_id': 'ae3ef8186a5d4502b06446d1c8569419', 'fixed_ips': [{'subnet_id': 'c3a7ac06-3392-4dcf-a75b-e9418337579c'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:22:20.220849 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:20.383990 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Allocated IP 192.168.233.2 (2b1283d5-cab9-4b45-879a-1d09bbf331c1/c3a7ac06-3392-4dcf-a75b-e9418337579c/4bb1122c-1be9-41dd-818b-fb315f49e7e0) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:22:20.589669 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:20.601251 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Transition to ACTIVE for port object 4bb1122c-1be9-41dd-818b-fb315f49e7e0 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:22:20.620447 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Transition to ACTIVE for port object 4bb1122c-1be9-41dd-818b-fb315f49e7e0 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:22:20.626259 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:20.631176 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:22:20.698145 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:22:20.700884 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:22:20.703877 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:22:20.709543 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Pushing event updated for resources: {'Port': ['ID=4bb1122c-1be9-41dd-818b-fb315f49e7e0,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:22:20.741351 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.741680 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.742004 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.742322 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.742635 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.742953 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.743267 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.743574 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.743925 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.744236 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.744541 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.744842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:22:20.759328 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:22:20.809301 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Attempting to bind port 4bb1122c-1be9-41dd-818b-fb315f49e7e0 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:22:20.809787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Attempting to bind port 4bb1122c-1be9-41dd-818b-fb315f49e7e0 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:22:20.810486 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Attempting to bind port 4bb1122c-1be9-41dd-818b-fb315f49e7e0 on network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:22:20.815622 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 22, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:22:20.816021 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Checking segment: {'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:22:20.816417 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:20.816952 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Bound using segment: {'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:22:20.817414 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Bound port: 4bb1122c-1be9-41dd-818b-fb315f49e7e0, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:22:20.818478 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:20.912520 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] For port 4bb1122c-1be9-41dd-818b-fb315f49e7e0, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:22:20.916054 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] For port 4bb1122c-1be9-41dd-818b-fb315f49e7e0, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=4bb1122c-1be9-41dd-818b-fb315f49e7e0,segment=NetworkSegment(86f13d3e-0be6-42ff-b615-3d835f455446),segment_id=86f13d3e-0be6-42ff-b615-3d835f455446)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:22:20.920947 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:20.925209 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:22:21.004710 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Pushing event updated for resources: {'Port': ['ID=4bb1122c-1be9-41dd-818b-fb315f49e7e0,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:22:21.008743 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:22:21.817723 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9475c0a0-34e5-41e5-bf28-440723b51011 None None] Network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:22:21.863326 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-b0e15794-b1b6-40ef-b466-b6a44dca4e52 None None] Provisioning for port 4bb1122c-1be9-41dd-818b-fb315f49e7e0 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:22:23.202920 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 4bb1122c-1be9-41dd-818b-fb315f49e7e0 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:22:23.273558 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 4bb1122c-1be9-41dd-818b-fb315f49e7e0 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:22:23.278016 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 4bb1122c-1be9-41dd-818b-fb315f49e7e0 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:22:23.278380 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:23.393623 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:23.427511 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 4bb1122c-1be9-41dd-818b-fb315f49e7e0, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=4bb1122c-1be9-41dd-818b-fb315f49e7e0,segment=NetworkSegment(86f13d3e-0be6-42ff-b615-3d835f455446),segment_id=86f13d3e-0be6-42ff-b615-3d835f455446)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:22:23.432950 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:23.435083 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:22:23.503645 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=4bb1122c-1be9-41dd-818b-fb315f49e7e0,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:22:23.507552 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:22:25.183720 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 4bb1122c-1be9-41dd-818b-fb315f49e7e0 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:22:25.251035 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 4bb1122c-1be9-41dd-818b-fb315f49e7e0 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:22:25.251404 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:29.699480 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:22:34.732007 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6546f847-1ef7-47af-be30-a43f25b1d768 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:37.151534 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:37.448384 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-bf4fd7b0-9281-4193-85a2-181c3a3f8912 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:38.213522 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:22:39.836198 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:04.733052 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e25f2f4e-d80d-49ba-8028-27448a4ac280 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:06.698742 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:23:07.155692 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:07.450841 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-667a1041-ff8e-4abb-a525-17ec5acbfcb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:08.216752 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:09.839581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:25.320943 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34500) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:23:25.327077 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [None req-6385e368-6460-473e-b78f-a7b9175df4b1 tempest-verify_tempest_config-1272235113 tempest-verify_tempest_config-1272235113-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:23:25.328058 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6385e368-6460-473e-b78f-a7b9175df4b1 tempest-verify_tempest_config-1272235113 tempest-verify_tempest_config-1272235113-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0061538 May 20 20:23:25.633128 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34518) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:23:25.751046 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:25.765038 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:23:25.768758 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Usage tracker for resource:security_group_rule and tenant:f9ed9c4c326f4d4ca7d49f62670f06c4 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:23:25.772163 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:23:25.777758 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:23:25.856715 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:25.860583 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:25.869042 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:23:25.905745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Synchronizing usage tracker for tenant:ae3ef8186a5d4502b06446d1c8569419 on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:23:25.909565 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1fb6bd5-4091-48dc-b42a-bc81ac0c3d97,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:23:25.918795 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.919144 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.919467 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.919803 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.920115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.920448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.920759 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.921067 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.921639 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.921944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.922246 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.922545 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:23:25.927280 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:23:25.935621 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Unset dirty status for tenant:ae3ef8186a5d4502b06446d1c8569419 on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:23:25.936893 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f9ed9c4c326f4d4ca7d49f62670f06c4&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3028090 May 20 20:23:25.939578 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34524) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:23:26.001215 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:26.027133 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:26.120203 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:26.124183 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-916eba80-f071-42d4-bdff-c98e53b89dcd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:23:26.135656 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1fb6bd5-4091-48dc-b42a-bc81ac0c3d97,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:23:26.139451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:23:26.142520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:26.143678 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f1fb6bd5-4091-48dc-b42a-bc81ac0c3d97 HTTP/1.1" status: 204 len: 168 time: 0.2031763 May 20 20:23:34.736662 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ad8c3ba7-c024-4ddd-8b84-d9e4d5530817 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:37.160037 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:37.454211 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-97e363be-46f5-4541-9079-e1f3d8c6689c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:38.221631 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:39.841569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:23:43.697344 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:24:04.739709 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3991be07-47f5-4ff5-aee6-186b4f8e6a43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:07.162337 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:07.456122 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-22e2d972-fcd4-40d1-9239-41871719e4aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:08.222910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:09.844281 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:20.696191 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:24:34.741419 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-643e1c88-c84a-4d15-98a6-a1d085ebf742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:37.167359 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:37.458311 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8d64ca64-1a14-434c-a70c-7b119e1e5728 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:38.226332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:39.849065 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:24:57.695282 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 5 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:25:04.744526 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1d2da145-6495-48ec-a268-ff1c10b61706 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:07.171382 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:07.459063 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-dd7cf39a-c669-43fe-b0a3-5aa18b6d2b18 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:08.229702 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:09.850111 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:11.168847 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020'] for agent, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:24.127735 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34598) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:25:24.242541 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c81ed4db-9b2e-4692-8de7-c1c10b98ac17 admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.1136763 May 20 20:25:26.388779 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34608) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:25:26.453274 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3ac5133d-66c1-4c1d-bfa6-77598cefcbb7 admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.0632701 May 20 20:25:34.693637 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:25:34.747737 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-f29b0981-2a56-498f-aca1-d2adb91f74b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:37.176240 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:37.461943 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-92683a91-ba29-40ad-a027-976f0cb0fecd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:38.231792 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:39.854992 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:25:41.120097 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:04.748320 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-017ccd5f-53b1-4bdc-a994-dad5ea27fa66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:07.180672 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:07.464311 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5aa224e4-b991-4cb5-a65d-aa97eebdcffa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:08.235497 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:09.857107 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:11.138198 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:11.692568 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:26:34.751103 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8b8eca10-ed92-46f0-94bb-5aae60ad7db9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:37.184889 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:37.467486 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d9619809-90be-4b0f-b5ae-ae995192c82b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:38.237818 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:39.861384 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:41.134053 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:26:48.691742 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:27:04.754063 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4d5f201a-1dc4-47ab-b5c5-68662cbb2654 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:04.807680 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34812) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:05.231620 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34836) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:05.270355 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34842) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:05.287861 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1971925032-network', 'tenant_id': '6eec95c790c84cfc8a6a2fbd90bb926c'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:05.296350 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.301253 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Usage tracker for resource:network and tenant:6eec95c790c84cfc8a6a2fbd90bb926c is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.304607 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.310795 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.322629 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34850) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:05.323436 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Made reservation on behalf of 6eec95c790c84cfc8a6a2fbd90bb926c for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:05.326196 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.339975 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.355366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.359518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Usage tracker for resource:security_group_rule and tenant:6eec95c790c84cfc8a6a2fbd90bb926c is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.363331 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.369518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.475603 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1502016291-network', 'tenant_id': '86c5233ea65940628ae25f1515bce737'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:05.482358 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.485496 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.488140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Usage tracker for resource:network and tenant:86c5233ea65940628ae25f1515bce737 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.492098 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.493007 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.502619 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.510271 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:05.520006 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-network', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:05.532591 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] vlan segment allocate from pool success with {'vlan_id': 832, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:27:05.535686 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Made reservation on behalf of 86c5233ea65940628ae25f1515bce737 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:05.538167 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.548366 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-238141999-network', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:05.554826 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.557924 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.558493 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Added segment 1fc195ac-b83c-4c30-9312-57e0ea98cebc of type vlan for network 2021d324-55d7-4959-b1a9-ee3e58b34538 May 20 20:27:05.573203 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Usage tracker for resource:network and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.578061 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.585642 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.587182 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.600136 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Made reservation on behalf of 831701ab26e241d0ac004d15e3ea0632 for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:05.603211 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.603884 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.607377 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Usage tracker for resource:network and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.610247 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.617495 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.630063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.633402 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.651559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.655885 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Usage tracker for resource:security_group_rule and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.659125 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.659496 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Made reservation on behalf of d5d038c87b86437990c22a9e55b308b6 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:05.662716 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.666739 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.678495 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.705627 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.709335 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.714112 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.718746 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Usage tracker for resource:security_group_rule and tenant:86c5233ea65940628ae25f1515bce737 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.722030 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Usage tracker for resource:security_group_rule and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.725500 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:05.726258 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.730569 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:05.747603 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.750340 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.763663 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.769773 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.770919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.772029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.772706 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.773221 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.773770 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.774168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.774498 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.774831 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.775169 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.775475 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.775958 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.776210 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.776566 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Tracked resource versions report: May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: pushed versions: May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: { 'AddressGroup': {'1.2'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'ConntrackHelper': {'1.0'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Log': {'1.0'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Network': {'1.1'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Port': {'1.7'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'PortForwarding': {'1.2'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'QosPolicy': {'1.8'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroup': {'1.4'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroupRule': {'1.2'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SubPort': {'1.0'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Subnet': {'1.1'}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Trunk': {'1.1'}} May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: consumer versions: May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: HyperV agent@hv-cinder-78462: {}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'ConntrackHelper': '1.0', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Log': '1.0', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Network': '1.1', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Port': '1.7', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'PortForwarding': '1.2', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'QosPolicy': '1.8', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroup': '1.4', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SecurityGroupRule': '1.2', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'SubPort': '1.0', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Subnet': '1.1', May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: 'Trunk': '1.1'}} May 20 20:27:05.777714 dv-cinder-784623-13-iscsi neutron-server[91645]: {{(pid=91645) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:27:05.780742 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.785085 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9762924 May 20 20:27:05.790816 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] vlan segment allocate from pool success with {'vlan_id': 843, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:27:05.793168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34876) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:05.798708 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:05.802156 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.803101 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Added segment d1427bab-94d8-4746-a3e3-cb687a069788 of type vlan for network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 May 20 20:27:05.805275 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-31d4235f-ade3-43c2-aaae-51090cfa9d0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.052s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:05.823664 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Request body: {'subnet': {'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1971925032-subnet', 'tenant_id': '6eec95c790c84cfc8a6a2fbd90bb926c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:05.828972 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.833017 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.833180 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Usage tracker for resource:subnet and tenant:6eec95c790c84cfc8a6a2fbd90bb926c is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.837245 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.844374 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.861219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e9de8410-c4ca-4607-9c50-0ef412897208 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:05.870747 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Made reservation on behalf of 6eec95c790c84cfc8a6a2fbd90bb926c for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:05.872502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.873635 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.876437 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:05.877007 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:05.912683 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.5855486 May 20 20:27:05.914492 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34882) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:05.924537 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Request body: {'subnet': {'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-238141999-subnet', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:05.930939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:05.935405 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Usage tracker for resource:subnet and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:05.938897 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:05.946257 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:05.954565 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=363bf234-ee18-49c0-afa7-bd1ec85ff1e8,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:05.964696 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Made reservation on behalf of 831701ab26e241d0ac004d15e3ea0632 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:05.967349 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Notify callbacks [] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.196812 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.197400 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.198011 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.198532 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.199520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.210346 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.210963 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.211538 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.212127 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.212696 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.213677 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.214207 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Tracked resource versions report: May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: pushed versions: May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: { 'AddressGroup': {'1.2'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'ConntrackHelper': {'1.0'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Log': {'1.0'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Network': {'1.1'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Port': {'1.7'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'PortForwarding': {'1.2'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'QosPolicy': {'1.8'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroup': {'1.4'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroupRule': {'1.2'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SubPort': {'1.0'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Subnet': {'1.1'}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Trunk': {'1.1'}} May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: consumer versions: May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: HyperV agent@hv-cinder-78462: {}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'ConntrackHelper': '1.0', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Log': '1.0', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Network': '1.1', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Port': '1.7', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'PortForwarding': '1.2', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'QosPolicy': '1.8', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroup': '1.4', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SecurityGroupRule': '1.2', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'SubPort': '1.0', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Subnet': '1.1', May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: 'Trunk': '1.1'}} May 20 20:27:06.216169 dv-cinder-784623-13-iscsi neutron-server[91646]: {{(pid=91646) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:27:06.227165 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.366s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:06.240900 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.340s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:06.292976 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.400296 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.403849 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Pushing event updated for resources: {'Network': ['ID=16b76e5b-322b-4d3c-b8d3-2d6888efd464,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:06.407407 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Pushing event updated for resources: {'Network': ['ID=2021d324-55d7-4959-b1a9-ee3e58b34538,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:06.408029 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:06.417122 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:27:06.473204 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.668s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:06.531613 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:06.565252 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=986983b6-1bd7-49d6-9a19-3836f95202fa,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:06.573814 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] vlan segment allocate from pool success with {'vlan_id': 812, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:27:06.576597 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:06.611180 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.611933 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Added segment 9fa7a75a-96c2-47f7-ab0c-41b383012256 of type vlan for network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 May 20 20:27:06.619441 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:27:06.750123 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.763001 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.791092 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.819509 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:06.872865 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1656c000-f292-4784-b09b-8e0b25b624d2,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:06.936181 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:06.951492 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] vlan segment allocate from pool success with {'vlan_id': 840, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:27:06.973385 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.985295 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:06.985736 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Added segment 1e05f149-338e-4199-8c1b-ffbf3489ad6c of type vlan for network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 May 20 20:27:06.987339 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:06.987964 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.001413 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:07.042692 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.049160 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-775452a3-08e0-4874-9385-e0dea934270b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:07.072425 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.110489 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.121103 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.8882256 May 20 20:27:07.122092 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34924) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:07.122330 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.139096 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Request body: {'subnet': {'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1502016291-subnet', 'tenant_id': '86c5233ea65940628ae25f1515bce737', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:07.150186 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:07.150769 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.179249 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:07.190892 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Pushing event updated for resources: {'Subnet': ['ID=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:07.194756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Usage tracker for resource:subnet and tenant:86c5233ea65940628ae25f1515bce737 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:07.204350 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.211469 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:07.216007 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:07.221837 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:07.225032 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.9521556 May 20 20:27:07.231332 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 34932) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:07.236612 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Checking segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:07.236968 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Network hostable DHCP agents. Network: 16b76e5b-322b-4d3c-b8d3-2d6888efd464, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:27:07.244095 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Request body: {'subnet': {'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-subnet', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:07.253120 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:07.266955 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Usage tracker for resource:subnet and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:07.274392 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:07.287529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Made reservation on behalf of 86c5233ea65940628ae25f1515bce737 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:07.290283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.291726 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Checking segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:07.292296 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Network hostable DHCP agents. Network: 2021d324-55d7-4959-b1a9-ee3e58b34538, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:27:07.314157 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Pushing event updated for resources: {'Network': ['ID=ba53435e-5386-4ba1-ad63-6c40a6baa7a1,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:07.325147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.324s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:07.325811 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8b17c335-8231-4b62-a80d-79afd09d483d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.183s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:07.329011 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:27:07.349988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:07.395404 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8debe367-8908-48d3-a2e2-6afb3c3cda2a,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:07.407934 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:27:07.420875 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:07.421286 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.233s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:07.569936 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Pushing event updated for resources: {'Network': ['ID=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:07.578754 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:07.607017 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 2021d324-55d7-4959-b1a9-ee3e58b34538) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:07.611746 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:07.612390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.647463 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:27:07.671821 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.8683078 May 20 20:27:07.686236 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03855c6a-6bec-4b23-aca7-cb463c7d5f46 None None] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:07.750662 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:27:07.778585 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34968) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:07.846476 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 16b76e5b-322b-4d3c-b8d3-2d6888efd464) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:07.866669 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:07.867386 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.896577 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Made reservation on behalf of d5d038c87b86437990c22a9e55b308b6 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:07.906164 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:07.965054 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b26dadd5-d738-4329-856f-5384b378fc17 None None] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:07.973646 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 2.0578239 May 20 20:27:07.977153 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34978) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:07.992586 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:08.014796 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:08.024649 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Usage tracker for resource:router and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:08.035411 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f15758f1-f917-4887-bb88-d5fb4ce784a3 None None] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:08.036514 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:08.065855 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:08.122866 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.153405 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.154832 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.170600 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:08.180473 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Usage tracker for resource:security_group_rule and tenant:a9c1e8dce8314cb5973164e3668ae84b is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:08.185023 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:08.194714 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:08.203075 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.459399 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d3042773-81ab-4851-9dad-0e78ec07e5cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.577540 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 34998) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:08.577849 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.601321 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.636454 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9a7263ed-f49c-4890-b94e-bb1adf8c453f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:08.683721 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.692746 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.701801 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.747320 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:08.780858 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60afc30e-046c-481e-8779-639378f64b09,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:08.782234 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Checking segment: {'id': '9fa7a75a-96c2-47f7-ab0c-41b383012256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 812, 'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:08.782627 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Network hostable DHCP agents. Network: ba53435e-5386-4ba1-ad63-6c40a6baa7a1, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:27:08.791107 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3305c376-fda9-4e41-a3fd-02e199629c67,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:08.796715 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:08.807514 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:27:08.808071 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:08.809050 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.883992 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:27:08.887926 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35020) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:08.902162 dv-cinder-784623-13-iscsi neutron-server[91646]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 20 20:27:08.915257 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.934090 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a9c1e8dce8314cb5973164e3668ae84b&name=default HTTP/1.1" status: 200 len: 2975 time: 1.1545322 May 20 20:27:08.938780 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35024) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:08.939990 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:08.951813 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Usage tracker for resource:security_group_rule and tenant:11de1a19bfc347188ef793111a46981a is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:08.965408 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:08.975623 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, ba53435e-5386-4ba1-ad63-6c40a6baa7a1) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:08.980744 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:08.981332 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:08.981954 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:09.046991 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.047965 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Allocated IP 172.20.0.2 (16b76e5b-322b-4d3c-b8d3-2d6888efd464/0f0b1ce3-e7c0-4e40-a18c-07e082124ea7/4d1d3fe6-a8d3-47d5-8a34-401e0920e835) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:09.077837 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.9500668 May 20 20:27:09.128034 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.141244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-a13460b9-70d5-431a-99a2-388cef331775 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:09.149808 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-a13460b9-70d5-431a-99a2-388cef331775 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 0.2582548 May 20 20:27:09.171719 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-e02bfe6c-cad1-4712-b391-227a177aca16 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/quotas/6eec95c790c84cfc8a6a2fbd90bb926c HTTP/1.1" status: 200 len: 375 time: 0.0209799 May 20 20:27:09.205052 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e12f3b0b-749e-476f-96ca-0cf90f6f2b4d None None] Network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:09.260186 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-061e6ae7-93d6-4545-b2fb-a16dfbf6d054 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0873809 May 20 20:27:09.311124 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.326257 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4c8cf88d-b2a8-4108-b315-7ab52cbc1172 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:09.491520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Pushing event updated for resources: {'Subnet': ['ID=113ead2b-c65c-4cf9-b6ed-724ff34a0db1,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:09.502938 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:09.531533 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-b6f62b8e-527c-4336-9882-df2e89825a1c service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:27:09.533142 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-b6f62b8e-527c-4336-9882-df2e89825a1c service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1473618 May 20 20:27:09.611988 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.641238 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.645195 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.647332 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.684302 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60b98d06-d774-471b-96cb-a38bd42f6682 None None] Network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:09.703829 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:09.716975 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.727248 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.739270 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60afc30e-046c-481e-8779-639378f64b09,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:09.742452 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:09.742924 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:09.764530 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-ef4a14a9-1142-47bd-b9ce-4b5cb91bdf58 service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2236426 May 20 20:27:09.768625 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Checking segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:09.769023 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Network hostable DHCP agents. Network: 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:27:09.809005 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Transition to ACTIVE for port object 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:09.834902 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c32522e-05ee-43f0-a540-cfe5db34ac12,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:09.838781 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:09.872135 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35068) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:09.875602 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.879341 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3fd0a2f1-2469-4873-a6a6-f74ac30ea03a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/60afc30e-046c-481e-8779-639378f64b09 HTTP/1.1" status: 204 len: 168 time: 0.9367995 May 20 20:27:09.884855 dv-cinder-784623-13-iscsi neutron-server[91645]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 20 20:27:09.885712 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Transition to ACTIVE for port object 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:09.891534 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.904767 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:09.907278 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=11de1a19bfc347188ef793111a46981a&name=default HTTP/1.1" status: 200 len: 2975 time: 1.3267567 May 20 20:27:09.914653 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-d81f6ab1-167c-479d-a326-fb35710983f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:09.919782 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35074) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:09.983892 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Pushing event updated for resources: {'Port': ['ID=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:10.109812 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:10.117235 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:10.120614 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.121218 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.121713 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.122637 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.123181 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.123707 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.124380 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.125893 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.125893 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.125893 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.126828 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.127688 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Tracked resource versions report: May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: pushed versions: May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: { 'AddressGroup': {'1.2'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'ConntrackHelper': {'1.0'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Log': {'1.0'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Network': {'1.1'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Port': {'1.7'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'PortForwarding': {'1.2'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'QosPolicy': {'1.8'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroup': {'1.4'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroupRule': {'1.2'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SubPort': {'1.0'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Subnet': {'1.1'}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Trunk': {'1.1'}} May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: consumer versions: May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: HyperV agent@hv-cinder-78462: {}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'ConntrackHelper': '1.0', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Log': '1.0', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Network': '1.1', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Port': '1.7', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'PortForwarding': '1.2', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'QosPolicy': '1.8', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroup': '1.4', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SecurityGroupRule': '1.2', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'SubPort': '1.0', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Subnet': '1.1', May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: 'Trunk': '1.1'}} May 20 20:27:10.129150 dv-cinder-784623-13-iscsi neutron-server[91647]: {{(pid=91647) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:27:10.132386 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Allocated IP 172.27.3.119 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/bbd1b22b-25f8-403b-9c74-e0f14c802c25) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:10.134508 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:27:10.136943 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:10.141704 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:10.169946 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:10.188171 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.189312 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:10.190162 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.196092 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-601d6b39-62de-4101-ab5e-81fcb4529bb9 service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4207540 May 20 20:27:10.230845 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 2.9970176 May 20 20:27:10.231680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35080) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:10.236912 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-c50eb123-37e0-4792-8e0b-4a6b48cf1a38 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:10.237616 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-c50eb123-37e0-4792-8e0b-4a6b48cf1a38 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Synchronizing usage tracker for tenant:86c5233ea65940628ae25f1515bce737 on resource:network {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:10.237752 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:10.243541 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:10.248356 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Usage tracker for resource:router and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:10.252383 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:10.262129 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:10.264606 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c383797a-4803-4726-a6c3-16968c226407 None None] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:10.290457 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.291642 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.324847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.343903 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.385470 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-c50eb123-37e0-4792-8e0b-4a6b48cf1a38 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Unset dirty status for tenant:86c5233ea65940628ae25f1515bce737 on resource:network {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:10.394327 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-c50eb123-37e0-4792-8e0b-4a6b48cf1a38 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/networks?id=ba53435e-5386-4ba1-ad63-6c40a6baa7a1 HTTP/1.1" status: 200 len: 812 time: 0.5198491 May 20 20:27:10.399595 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Attempting to bind port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:10.401876 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Attempting to bind port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:10.402501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Attempting to bind port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:10.422564 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:10.423460 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Checking segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:10.424261 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.424980 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Bound using segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:10.425727 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Bound port: 4d1d3fe6-a8d3-47d5-8a34-401e0920e835, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:10.426326 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.437915 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-fb685dd9-00e6-4d0d-93d7-5908ef0f7516 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/quotas/86c5233ea65940628ae25f1515bce737 HTTP/1.1" status: 200 len: 375 time: 0.0426502 May 20 20:27:10.558675 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35094) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:10.583636 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-9d128c3c-48e3-4203-b108-5373d95ecdb7 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=86c5233ea65940628ae25f1515bce737&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1445625 May 20 20:27:10.669636 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.704693 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.742205 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:10.746734 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Usage tracker for resource:security_group_rule and tenant:d05da922038b4f2891bb0ed45dd070ec is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:10.752901 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:10.763463 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:10.768167 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.838590 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-55972422-bcbf-449d-b74b-a1605f8e46d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:10.858267 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.883782 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-07a0b06d-a5da-4ab3-bae1-a69a334897a0 req-4d38958b-f25a-46fc-b824-503b64559b82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0825577 May 20 20:27:10.916236 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] For port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:10.921768 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c32522e-05ee-43f0-a540-cfe5db34ac12,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:10.930220 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:27:10.931454 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.957516 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] For port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:10.967493 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:10.985174 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:11.014509 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:11.026214 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.045882 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.047168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:11.098445 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-ab8adea2-2ca6-4b13-bfae-3f89fc64db72 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91645) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:27:11.100378 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-ab8adea2-2ca6-4b13-bfae-3f89fc64db72 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3104231 May 20 20:27:11.112786 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.165797 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.166873 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0c32522e-05ee-43f0-a540-cfe5db34ac12 HTTP/1.1" status: 204 len: 168 time: 1.2445581 May 20 20:27:11.179215 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:11.184928 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Pushing event updated for resources: {'Port': ['ID=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:11.188871 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:11.210621 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:11.220762 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:11.292766 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Allocated IP 172.20.0.2 (5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528/113ead2b-c65c-4cf9-b6ed-724ff34a0db1/b55941a7-4e87-49e6-a7d6-98160936fa17) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:11.343740 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.390629 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.433435 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.496990 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-81ed9c4b-390f-4fc7-ba10-d58edb0e5e1c service neutron] 10.222.0.82 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3718677 May 20 20:27:11.504778 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d05da922038b4f2891bb0ed45dd070ec&name=default HTTP/1.1" status: 200 len: 2975 time: 0.9173164 May 20 20:27:11.513148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35142) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:11.684947 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Allocated IP 172.27.3.254 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/63c29677-de58-48bf-90f2-b11cdbd2fe54) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:11.687122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.719498 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.737044 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Transition to ACTIVE for port object b55941a7-4e87-49e6-a7d6-98160936fa17 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:11.746109 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Pushing event updated for resources: {'Port': ['ID=bbd1b22b-25f8-403b-9c74-e0f14c802c25,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:11.757851 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.711s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:11.770280 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Transition to ACTIVE for port object b55941a7-4e87-49e6-a7d6-98160936fa17 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:11.780599 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.787010 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:11.793008 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:11.847169 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:11.855993 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:11.860565 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:11.912943 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8636642c-0665-48f4-bbbc-b26e81d7cf50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.747s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:11.995685 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Pushing event updated for resources: {'Port': ['ID=b55941a7-4e87-49e6-a7d6-98160936fa17,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:11.999454 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:12.028299 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Attempting to bind port b55941a7-4e87-49e6-a7d6-98160936fa17 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:12.028707 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Attempting to bind port b55941a7-4e87-49e6-a7d6-98160936fa17 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:12.029700 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Attempting to bind port b55941a7-4e87-49e6-a7d6-98160936fa17 on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:12.038735 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:12.039992 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Checking segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:12.040629 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.042807 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Bound using segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:12.042807 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Bound port: b55941a7-4e87-49e6-a7d6-98160936fa17, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:12.042807 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.072687 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-a6de0437-3301-4925-8d91-904000b4ca0a service neutron] 10.222.0.82 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5340497 May 20 20:27:12.076359 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a10d6b24-2c96-4978-bbf3-731412468d5a,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:12.096701 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:12.187479 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.206381 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-75dd324d-7c40-45c5-a93b-06ac1d4c099a req-2b37bd66-0f0c-4f8e-8fba-94ef5b0b4bb5 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.1822910 May 20 20:27:12.210738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:12.261752 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.266135 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a10d6b24-2c96-4978-bbf3-731412468d5a HTTP/1.1" status: 204 len: 168 time: 0.7519934 May 20 20:27:12.268220 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a10d6b24-2c96-4978-bbf3-731412468d5a,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:12.270848 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:12.277291 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] For port b55941a7-4e87-49e6-a7d6-98160936fa17, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:12.291755 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] For port b55941a7-4e87-49e6-a7d6-98160936fa17, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b55941a7-4e87-49e6-a7d6-98160936fa17,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:12.301318 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.331051 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.341818 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:12.360901 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.366366 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:12.555064 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Pushing event updated for resources: {'Port': ['ID=b55941a7-4e87-49e6-a7d6-98160936fa17,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:12.561146 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:12.625446 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6fd43bde-52e7-478c-a5db-049ffcb17927 req-231b5103-ea14-480d-bf74-c675373b8ec3 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 210 time: 0.1127880 May 20 20:27:12.652974 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Pushing event updated for resources: {'Port': ['ID=63c29677-de58-48bf-90f2-b11cdbd2fe54,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:12.652974 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.283s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:12.654464 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:12.658115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:12.664822 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:12.728374 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:12.979975 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddb84030-709a-4f14-a89c-0b832ab0ca4c None None] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:13.159941 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-73e3c35d-58ab-4d1a-9b52-3a5fc4a44b95 None None] Provisioning for port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:13.471703 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:13.638229 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:13.701732 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0f6b9941-98b3-4f0d-b80e-e644aff5c5c8 req-a5894007-3e9a-4e4e-b5f1-4205d3752b57 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.1016648 May 20 20:27:13.821769 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-15fe4bb1-21cf-45ad-8121-1f710086d954 req-6de7df3d-f634-4953-a607-66fc708f6dd8 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 210 time: 0.1181850 May 20 20:27:13.828908 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:13.861704 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:13.867110 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:13.867474 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:14.086574 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91645) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:27:14.203038 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:14.215437 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc304f3b-48e2-4b80-b501-7696562b7254 None None] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:27:14.355939 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:14.359019 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-f5dac2cb-693d-4f9d-b4d4-94acebab6b37 None None] Provisioning for port b55941a7-4e87-49e6-a7d6-98160936fa17 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:14.377781 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:14.385649 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b55941a7-4e87-49e6-a7d6-98160936fa17 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:14.421021 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:14.475459 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:27:14.481001 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:14.488725 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Sync routers for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:27:14.516847 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:14.519253 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:14.530844 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:14.532134 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 6.5539553 May 20 20:27:14.534955 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35272) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:14.703753 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-f5dac2cb-693d-4f9d-b4d4-94acebab6b37 None None] Provisioning complete for port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:14.704644 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-f5dac2cb-693d-4f9d-b4d4-94acebab6b37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:14.855217 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port b55941a7-4e87-49e6-a7d6-98160936fa17 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:14.918437 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Router cdb694ee-b9bf-4ffe-895b-e76ca953be5d is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91646) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:27:14.975247 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:14.984648 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.564s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:14.986691 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port b55941a7-4e87-49e6-a7d6-98160936fa17 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:14.987127 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:15.137399 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:15.339834 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dcaf5b67-3423-4e96-ae29-48c65b555bb8 req-5fe4519e-6672-4281-b6dc-ab9b28004a31 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 210 time: 0.1327653 May 20 20:27:15.355637 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:27:15.371227 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Sync routers for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:27:15.398763 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:15.429225 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:15.429902 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:15.450271 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b9be5993-086c-4362-91f9-62c5e720efbe req-195fae5f-1694-4c71-b33f-3086b5078aef tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0960474 May 20 20:27:15.501139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:15.502330 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 5.2696185 May 20 20:27:15.505010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35308) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:15.633701 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port b55941a7-4e87-49e6-a7d6-98160936fa17, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b55941a7-4e87-49e6-a7d6-98160936fa17,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:15.795209 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:12Z', 'revision_number': 3, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:15.809291 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Checking router: e666c92f-d3d0-46f1-aeb9-c3dd182bf186 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:27:15.809412 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Updating router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 port bbd1b22b-25f8-403b-9c74-e0f14c802c25 binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:27:15.843082 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:15.874751 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.69', 52463) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:16.000871 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:16.440870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:16.462008 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-a337de92-21b1-4cfb-9fc9-ab85751b06f0 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:16.463557 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-a337de92-21b1-4cfb-9fc9-ab85751b06f0 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.69 "GET /v2.0/networks?id=ba53435e-5386-4ba1-ad63-6c40a6baa7a1 HTTP/1.1" status: 200 len: 812 time: 0.5877540 May 20 20:27:16.468366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35352) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:16.551697 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-bc050153-a43f-41db-a956-7248981ebb06 None None] Provisioning complete for port b55941a7-4e87-49e6-a7d6-98160936fa17 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:16.552238 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-bc050153-a43f-41db-a956-7248981ebb06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:16.615205 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Request body: {'port': {'device_id': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1', 'admin_state_up': True, 'tenant_id': '86c5233ea65940628ae25f1515bce737'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:16.676064 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-1069b89f-b43e-43d5-9c75-e9053d0e4ff1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:16.804866 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:16.815579 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f1556c83-1774-4d63-b0eb-c8dc64bca3c8 req-1ba63b32-97cc-4e3e-a1c8-892806b1fe99 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 210 time: 0.1635323 May 20 20:27:16.885640 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:16.906399 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:16.908666 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Transition to ACTIVE for port object bbd1b22b-25f8-403b-9c74-e0f14c802c25 will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:16.926849 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:16.947072 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:16.974737 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.69', 52472) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:17.004594 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.009273 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=b55941a7-4e87-49e6-a7d6-98160936fa17,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:17.025879 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:17.043018 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-30d33941-b1c6-4f56-9405-5c58776d1e40 req-219d3332-2da6-4fe2-b989-99091011f3c9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.2623794 May 20 20:27:17.044071 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Usage tracker for resource:security_group_rule and tenant:c636015b729f449a8ea0c22bd8241d49 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:17.105495 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:17.114997 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.439s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:17.126385 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:13Z', 'revision_number': 3, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:17.137713 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Checking router: cdb694ee-b9bf-4ffe-895b-e76ca953be5d for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:27:17.138101 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Updating router cdb694ee-b9bf-4ffe-895b-e76ca953be5d port 63c29677-de58-48bf-90f2-b11cdbd2fe54 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:27:17.175107 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:17.197688 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:17.198134 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.214131 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Pushing event updated for resources: {'Port': ['ID=bbd1b22b-25f8-403b-9c74-e0f14c802c25,revision_number=2']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:17.220897 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Attempting to bind port bbd1b22b-25f8-403b-9c74-e0f14c802c25 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:17.220897 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Attempting to bind port bbd1b22b-25f8-403b-9c74-e0f14c802c25 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:17.220897 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Attempting to bind port bbd1b22b-25f8-403b-9c74-e0f14c802c25 on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:17.246183 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:17.250882 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Usage tracker for resource:port and tenant:86c5233ea65940628ae25f1515bce737 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:17.254658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:17.255008 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.257178 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.258555 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.259041 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.259181 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.260024 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.261870 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.262471 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.262954 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.263353 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:17.264721 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.265212 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.266971 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.268960 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Tracked resource versions report: May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: pushed versions: May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: { 'AddressGroup': {'1.2'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'ConntrackHelper': {'1.0'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Log': {'1.0'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Network': {'1.1'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Port': {'1.7'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'PortForwarding': {'1.2'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'QosPolicy': {'1.8'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroup': {'1.4'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroupRule': {'1.2'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SubPort': {'1.0'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Subnet': {'1.1'}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Trunk': {'1.1'}} May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: consumer versions: May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: { DHCP agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: HyperV agent@hv-cinder-78462: {}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: L3 agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: Metadata agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: Metering agent@dv-cinder-784623-13-iscsi: {}, May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: Open vSwitch agent@dv-cinder-784623-13-iscsi: { 'AddressGroup': '1.2', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'ConntrackHelper': '1.0', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Log': '1.0', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Network': '1.1', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Port': '1.7', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'PortForwarding': '1.2', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'QosPolicy': '1.8', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroup': '1.4', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SecurityGroupRule': '1.2', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'SubPort': '1.0', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Subnet': '1.1', May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: 'Trunk': '1.1'}} May 20 20:27:17.273478 dv-cinder-784623-13-iscsi neutron-server[91648]: {{(pid=91648) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 20 20:27:17.295137 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Made reservation on behalf of 86c5233ea65940628ae25f1515bce737 for: {'port': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:17.295605 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:17.300536 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.305769 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:17.306600 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:17.307448 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.308696 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:17.309338 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Bound port: bbd1b22b-25f8-403b-9c74-e0f14c802c25, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:17.320440 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.433477 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4f124df5-d4d6-4249-aa0c-59695121064d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:17.435939 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4f124df5-d4d6-4249-aa0c-59695121064d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 0.4552062 May 20 20:27:17.437834 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] For port bbd1b22b-25f8-403b-9c74-e0f14c802c25, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:17.445933 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] For port bbd1b22b-25f8-403b-9c74-e0f14c802c25, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=bbd1b22b-25f8-403b-9c74-e0f14c802c25,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:17.454302 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.462385 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:17.554865 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:17.556503 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:17.678519 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:17.814772 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Allocated IP 172.20.0.2 (ba53435e-5386-4ba1-ad63-6c40a6baa7a1/3305c376-fda9-4e41-a3fd-02e199629c67/8898bc07-0bec-49b5-b671-821ceb98b64c) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:17.819065 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Pushing event updated for resources: {'Port': ['ID=bbd1b22b-25f8-403b-9c74-e0f14c802c25,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:17.840694 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.376s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:17.845466 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:18.039925 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Allocated IP 172.20.0.1 (16b76e5b-322b-4d3c-b8d3-2d6888efd464/0f0b1ce3-e7c0-4e40-a18c-07e082124ea7/181874e7-6fac-4648-9d3e-ed7f7c298702) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:18.040765 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Allocated IP 172.20.0.1 (5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528/113ead2b-c65c-4cf9-b6ed-724ff34a0db1/07986231-dfc0-427e-81fe-e80e576bf2aa) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:18.128577 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.151569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Transition to ACTIVE for port object 63c29677-de58-48bf-90f2-b11cdbd2fe54 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:18.172891 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.183452 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:18.250415 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.273526 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-113b7104-df12-4fa1-9de8-30292e2d0afa req-be4740c2-aa1f-4a4b-80ed-a69bdc701837 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 210 time: 0.1565857 May 20 20:27:18.280869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.311390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.317355 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6864a7-1e0d-4838-a58f-1733111245b3 None None] Pushing event updated for resources: {'Port': ['ID=63c29677-de58-48bf-90f2-b11cdbd2fe54,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:18.318114 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-78b8161f-9c7f-46c2-a46b-1eb305cf6bbf req-a62d79c6-2863-476f-995e-4c70f9cb5e0f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0583498 May 20 20:27:18.322730 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4b6864a7-1e0d-4838-a58f-1733111245b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:18.344050 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Attempting to bind port 63c29677-de58-48bf-90f2-b11cdbd2fe54 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:18.344703 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Attempting to bind port 63c29677-de58-48bf-90f2-b11cdbd2fe54 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:18.345192 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Attempting to bind port 63c29677-de58-48bf-90f2-b11cdbd2fe54 on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:18.351804 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:18.352034 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Transition to ACTIVE for port object 07986231-dfc0-427e-81fe-e80e576bf2aa will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:18.352153 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:18.352153 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.352528 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:18.352946 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Bound port: 63c29677-de58-48bf-90f2-b11cdbd2fe54, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:18.353672 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.360901 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:18.402921 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:12Z', 'revision_number': 3, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:18.409662 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.417478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:18.426178 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c3dda5-e678-4926-b019-a7a83d806ab9 None None] The sync data for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi is: [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:12Z', 'revision_number': 3, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:27:18.448740 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] For port 63c29677-de58-48bf-90f2-b11cdbd2fe54, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:18.452227 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] For port 63c29677-de58-48bf-90f2-b11cdbd2fe54, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=63c29677-de58-48bf-90f2-b11cdbd2fe54,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:18.459287 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.463978 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:18.503702 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Pushing event updated for resources: {'Port': ['ID=07986231-dfc0-427e-81fe-e80e576bf2aa,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:18.508088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:18.519004 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:18.520306 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:18.535050 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:18.535488 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.561326 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.572848 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c636015b729f449a8ea0c22bd8241d49&name=default HTTP/1.1" status: 200 len: 2975 time: 2.1034119 May 20 20:27:18.580933 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:18.581445 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:18.594004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35414) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:18.627136 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43fa911e-4b73-42db-b98e-723c4ac5048b,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:18.669404 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b55941a7-4e87-49e6-a7d6-98160936fa17 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:18.688860 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:18.706512 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.754754 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6864a7-1e0d-4838-a58f-1733111245b3 None None] Pushing event updated for resources: {'Port': ['ID=63c29677-de58-48bf-90f2-b11cdbd2fe54,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:18.758106 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.816001 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4b6864a7-1e0d-4838-a58f-1733111245b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.352s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:18.839922 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Transition to ACTIVE for port object 181874e7-6fac-4648-9d3e-ed7f7c298702 will not be triggered until provisioned by entity DHCP. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:18.885729 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.923403 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.932368 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.945844 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:18.964186 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-9b593758-f495-47df-a360-8371e23728e7 None None] Provisioning for port 07986231-dfc0-427e-81fe-e80e576bf2aa completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:18.977608 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port b55941a7-4e87-49e6-a7d6-98160936fa17 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:18.978248 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.010591 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:19.053105 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ab54eafa-58b8-4933-adfd-b5c6e3973322 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:19.089759 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.099817 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.101132 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.107485 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a63c92bd-5188-47b5-b2a3-8f087569de68 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:19.169464 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:19.171255 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-9b593758-f495-47df-a360-8371e23728e7 None None] Provisioning complete for port 07986231-dfc0-427e-81fe-e80e576bf2aa triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:19.171807 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9b593758-f495-47df-a360-8371e23728e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.173909 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:19.182640 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:19.188353 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:19.189014 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.199969 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:19.213413 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Pushing event updated for resources: {'Port': ['ID=8898bc07-0bec-49b5-b671-821ceb98b64c,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:19.215235 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Pushing event updated for resources: {'Port': ['ID=07986231-dfc0-427e-81fe-e80e576bf2aa,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:19.215969 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:19.241448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:19.283486 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-9b593758-f495-47df-a360-8371e23728e7 None None] Port 07986231-dfc0-427e-81fe-e80e576bf2aa cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:27:19.329049 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:19.329565 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.363071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:19.364704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:19.700322 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-f82d5f63-85da-4020-a717-1b202c8aaca1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.0902436 May 20 20:27:19.701166 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.708892 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Pushing event updated for resources: {'Port': ['ID=181874e7-6fac-4648-9d3e-ed7f7c298702,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:19.714458 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Router cdb694ee-b9bf-4ffe-895b-e76ca953be5d has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:27:19.720119 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.721502 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/43fa911e-4b73-42db-b98e-723c4ac5048b HTTP/1.1" status: 204 len: 168 time: 1.1033998 May 20 20:27:19.725537 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4384b39e-5d96-432a-976b-34a3cbd3d6d8 req-a1661b8e-a88e-4cad-944a-b12b7a3c6616 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0965946 May 20 20:27:19.734063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.680s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:19.734913 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.602s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:19.735819 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:19.738533 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.008s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:19.768771 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43fa911e-4b73-42db-b98e-723c4ac5048b,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:19.788158 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:19.897520 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-ea95b904-e232-42de-8111-77faa115cbed None None] Provisioning for port 181874e7-6fac-4648-9d3e-ed7f7c298702 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:19.904227 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-ea95b904-e232-42de-8111-77faa115cbed None None] Provisioning complete for port 181874e7-6fac-4648-9d3e-ed7f7c298702 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:19.904574 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ea95b904-e232-42de-8111-77faa115cbed None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:19.987523 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-ea95b904-e232-42de-8111-77faa115cbed None None] Port 181874e7-6fac-4648-9d3e-ed7f7c298702 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:27:19.991154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:27:20.022216 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] 10.222.0.82 "PUT /v2.0/routers/cdb694ee-b9bf-4ffe-895b-e76ca953be5d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5149524 May 20 20:27:20.041209 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-ea95b904-e232-42de-8111-77faa115cbed None None] Provisioning complete for port 07986231-dfc0-427e-81fe-e80e576bf2aa triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:20.041480 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ea95b904-e232-42de-8111-77faa115cbed None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.042571 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c3323af-5a18-42df-ac7e-e719c4963dc5 req-bfa26549-c9c5-4a72-a803-ad09464f1f10 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:20.044776 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4c3323af-5a18-42df-ac7e-e719c4963dc5 req-bfa26549-c9c5-4a72-a803-ad09464f1f10 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.3721950 May 20 20:27:20.115923 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.141056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-ea95b904-e232-42de-8111-77faa115cbed None None] Port 07986231-dfc0-427e-81fe-e80e576bf2aa cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:27:20.151437 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4c3323af-5a18-42df-ac7e-e719c4963dc5 req-be54e9b3-e2ba-4ce2-ac94-6ecfab7bb29f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998263 May 20 20:27:20.155561 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:20.160507 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f6ddf51-95b6-4fdb-a341-ff60f746f92e None None] The sync data for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi is: [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:27:20.360771 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35444) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:20.400557 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.431521 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:20.437249 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Usage tracker for resource:security_group_rule and tenant:e18a00ed774b4fcc9018369eb360eafc is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:20.440435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:20.448346 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:20.496582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.502313 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.503864 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.514600 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a66706c0-2253-4799-92a8-685d678d8ab1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:20.613405 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Pushing event updated for resources: {'Port': ['ID=181874e7-6fac-4648-9d3e-ed7f7c298702,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:20.617130 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:20.649812 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.656520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:20.732445 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dde7f0ff-8e57-4193-85c1-d678f628faca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:20.840821 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bbd1b22b-25f8-403b-9c74-e0f14c802c25 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:20.894892 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:20.896825 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:20.915622 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e18a00ed774b4fcc9018369eb360eafc&name=default HTTP/1.1" status: 200 len: 2975 time: 0.5524106 May 20 20:27:20.916290 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35458) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:20.939708 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd8a2e36-8706-424d-a05e-b6ca59d95723,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:20.957443 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:21.072620 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port bbd1b22b-25f8-403b-9c74-e0f14c802c25 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:21.087981 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port bbd1b22b-25f8-403b-9c74-e0f14c802c25 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:21.088500 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.103525 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.178385 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.303838 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d73cbb22-be54-45a5-a4fb-8cddb9f01501 req-3b412901-4005-48da-893d-04b5bb548ab4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.1942487 May 20 20:27:21.319289 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.343477 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:21.359719 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd8a2e36-8706-424d-a05e-b6ca59d95723,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:21.360147 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.364116 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:21.368888 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.373221 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cd8a2e36-8706-424d-a05e-b6ca59d95723 HTTP/1.1" status: 204 len: 168 time: 0.4549947 May 20 20:27:21.465563 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port bbd1b22b-25f8-403b-9c74-e0f14c802c25, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=bbd1b22b-25f8-403b-9c74-e0f14c802c25,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:21.474494 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-35bb9fdd-f3b9-4a8e-ae14-dfd3ab4d5edf None None] Provisioning complete for port 181874e7-6fac-4648-9d3e-ed7f7c298702 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:21.476903 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-35bb9fdd-f3b9-4a8e-ae14-dfd3ab4d5edf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.553164 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:21.592883 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4b6864a7-1e0d-4838-a58f-1733111245b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:21.671733 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-35bb9fdd-f3b9-4a8e-ae14-dfd3ab4d5edf None None] Port 181874e7-6fac-4648-9d3e-ed7f7c298702 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:27:21.676448 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:27:21.684370 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=bbd1b22b-25f8-403b-9c74-e0f14c802c25,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:21.690616 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:21.888175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35480) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:21.893963 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1157054176', 'description': 'tempest-description--58671818'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:21.904395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:21.930755 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:21.937504 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:21.946003 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:21.967342 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:22.061805 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:22.072155 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group_rule and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:22.078098 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:22.106700 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca05205c-9326-4384-9503-9e7d6bdd3969 req-8166b7f9-af32-40c3-9268-d7ca4be43c85 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:22.107437 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-ca05205c-9326-4384-9503-9e7d6bdd3969 req-8166b7f9-af32-40c3-9268-d7ca4be43c85 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Synchronizing usage tracker for tenant:86c5233ea65940628ae25f1515bce737 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:22.116437 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:22.384591 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:22.392276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:22.405702 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e68a3591-c411-46c5-bdd6-f6afadc790c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:22.407004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-ca05205c-9326-4384-9503-9e7d6bdd3969 req-8166b7f9-af32-40c3-9268-d7ca4be43c85 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Unset dirty status for tenant:86c5233ea65940628ae25f1515bce737 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:22.425778 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ca05205c-9326-4384-9503-9e7d6bdd3969 req-8166b7f9-af32-40c3-9268-d7ca4be43c85 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.8330090 May 20 20:27:22.490838 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:22.492134 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1776 time: 0.6027422 May 20 20:27:22.494952 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35512) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:22.517680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3dbb244a-aebf-4ce5-9550-40907a2dbee9,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:22.519028 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:27:22.522494 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:22.530599 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'security_group_rule': {'security_group_id': '3dbb244a-aebf-4ce5-9550-40907a2dbee9', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:22.534033 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Sync routers for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:27:22.551165 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:22.551945 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:22.581841 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] 10.222.0.82 "PUT /v2.0/routers/e666c92f-d3d0-46f1-aeb9-c3dd182bf186/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.0457249 May 20 20:27:22.613736 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:22.665044 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group_rule and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:22.676190 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:22.742280 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:22.757000 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fb9035fb-d144-49b2-b5d8-3878d0c8489f req-2170f89d-68c9-491f-ac9d-384bae6922e0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.1181960 May 20 20:27:22.770594 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-ca05205c-9326-4384-9503-9e7d6bdd3969 req-1c6b33e6-f79c-4673-85bf-3c58d62be647 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Synchronizing usage tracker for tenant:86c5233ea65940628ae25f1515bce737 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:22.842466 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:22.859015 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-ca05205c-9326-4384-9503-9e7d6bdd3969 req-1c6b33e6-f79c-4673-85bf-3c58d62be647 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Unset dirty status for tenant:86c5233ea65940628ae25f1515bce737 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:22.880990 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ca05205c-9326-4384-9503-9e7d6bdd3969 req-1c6b33e6-f79c-4673-85bf-3c58d62be647 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4542372 May 20 20:27:22.984028 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 63c29677-de58-48bf-90f2-b11cdbd2fe54 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:23.038359 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.055967 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.058205 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:23.114033 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4e14f47-348a-4006-b61d-1c299845baee,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:23.120197 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:23.129763 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.131133 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 63c29677-de58-48bf-90f2-b11cdbd2fe54 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:23.132322 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:23.132950 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6301687 May 20 20:27:23.134825 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35526) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:23.140355 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 63c29677-de58-48bf-90f2-b11cdbd2fe54 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:23.141051 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'security_group_rule': {'security_group_id': '3dbb244a-aebf-4ce5-9550-40907a2dbee9', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:23.141371 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.153839 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:23.167742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group_rule and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:23.180455 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:23.195162 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:23.223495 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35532) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:23.264720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.326901 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.357699 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 63c29677-de58-48bf-90f2-b11cdbd2fe54, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=63c29677-de58-48bf-90f2-b11cdbd2fe54,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:23.376913 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.378533 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bbd1b22b-25f8-403b-9c74-e0f14c802c25 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:23.486973 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:23.506560 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.514559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.516643 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:23.548493 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=625b6455-1bc4-4029-982c-f46a91477dbf,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:23.611335 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.709492 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:23.714926 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=63c29677-de58-48bf-90f2-b11cdbd2fe54,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:23.715100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.716432 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5803866 May 20 20:27:23.723731 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:23.725410 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35546) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:23.729759 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:23.750152 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:23.764511 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Usage tracker for resource:security_group_rule and tenant:919ec97097d44b3487b62f3adb7a03e2 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:23.768354 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port bbd1b22b-25f8-403b-9c74-e0f14c802c25 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:23.769947 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:23.777238 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:23.787530 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:23.810145 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:23.825031 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:floatingip and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:23.849844 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:23.872874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:23.904683 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:24.038461 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Sync routers for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:27:24.081116 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:24.081740 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:24.242114 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d8e14c6e-cbc1-47da-b39d-524f0eff7f4d req-804c33bf-d57c-484d-a61f-97796f747993 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.1729214 May 20 20:27:24.259358 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:24.269151 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:24.283078 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-1bc97628-c470-4153-8436-6b6ebf57cbcb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:24.307613 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:20Z', 'revision_number': 2, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:24.331513 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Checking router: e666c92f-d3d0-46f1-aeb9-c3dd182bf186 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:27:24.331967 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Updating router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 port 181874e7-6fac-4648-9d3e-ed7f7c298702 binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:27:24.374723 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:24.523812 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=919ec97097d44b3487b62f3adb7a03e2&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2990634 May 20 20:27:24.527994 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35566) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:24.534455 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38801262-4739-4358-baa4-83d094f0ef6e,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:24.559108 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:24.615972 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:24.787511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35580) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:24.811720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1865956538', 'description': 'tempest-description--104320593'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:24.858570 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:24.868808 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:24.873628 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:24.878794 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:24.928820 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Allocated IP 172.27.3.32 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/a01ef44d-8f06-4963-aeb4-4bed7b67e7c2) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:24.930986 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:25.017676 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.031151 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.073567 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:25.080466 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group_rule and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:25.085167 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 63c29677-de58-48bf-90f2-b11cdbd2fe54 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:25.086709 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77555bb3-3d4c-4253-919a-12f1122f1598 req-fd22ba04-d996-42ab-9b11-4a33fc3fef0f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:25.094024 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-77555bb3-3d4c-4253-919a-12f1122f1598 req-fd22ba04-d996-42ab-9b11-4a33fc3fef0f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.4658384 May 20 20:27:25.157564 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.222919 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:25.261608 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:25.271386 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-77555bb3-3d4c-4253-919a-12f1122f1598 req-f0ebd02c-b483-4b43-938b-74e42e2884ab tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1702111 May 20 20:27:25.315301 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.329013 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:25.390303 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38801262-4739-4358-baa4-83d094f0ef6e,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:25.409316 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:25.423029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.425327 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/38801262-4739-4358-baa4-83d094f0ef6e HTTP/1.1" status: 204 len: 168 time: 0.8931355 May 20 20:27:25.447165 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.507078 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.515208 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:25.613094 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.628482 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Transition to ACTIVE for port object 181874e7-6fac-4648-9d3e-ed7f7c298702 will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:25.644291 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.651151 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-178ee594-f832-4a5c-8665-2cc9e29b7348 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:25.675679 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'Port': ['ID=a01ef44d-8f06-4963-aeb4-4bed7b67e7c2,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:25.695283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:25.700413 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:25.702616 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:25.705197 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.706666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:25.791309 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f169b1bd-2c89-4e3c-87d6-537c2b08b945 None None] Pushing event updated for resources: {'Port': ['ID=181874e7-6fac-4648-9d3e-ed7f7c298702,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:25.806854 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5b264ca3-1d15-424b-ab16-b190f1f2636b req-ebf63729-8343-4ac6-9f45-3cc956a629dd tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.1981676 May 20 20:27:25.827707 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.830401 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-f169b1bd-2c89-4e3c-87d6-537c2b08b945 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:25.845760 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:27:25.898807 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 63c29677-de58-48bf-90f2-b11cdbd2fe54 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:25.899370 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.902674 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8a5ddaed-20fe-4395-9e63-6c55c2caab86 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:25.928087 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:25.932486 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35618) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:25.932990 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 1.1434660 May 20 20:27:25.941374 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'security_group_rule': {'security_group_id': '68f68b1b-776a-426b-aa7f-53510f02ba9d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:25.962095 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:25.976856 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group_rule and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:25.995750 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:26.015634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.018216 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:26.023079 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'SecurityGroup': ['ID=68f68b1b-776a-426b-aa7f-53510f02ba9d,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:26.043607 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:26.077578 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.264629 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.292886 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.300845 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.305755 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b7ddd70f-be14-4cb9-bae4-f46cdfa9181d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:26.390569 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ea3237e8-6ce8-4eb8-b707-9e9602e9b03e,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:26.417518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:26.436287 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Attempting to bind port 181874e7-6fac-4648-9d3e-ed7f7c298702 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:26.437775 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Attempting to bind port 181874e7-6fac-4648-9d3e-ed7f7c298702 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:26.438154 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Attempting to bind port 181874e7-6fac-4648-9d3e-ed7f7c298702 on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:26.444152 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.445439 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5110924 May 20 20:27:26.448437 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35646) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:26.460328 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:26.460654 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Checking segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:26.462213 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.464024 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Bound using segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:26.465476 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'security_group_rule': {'security_group_id': '68f68b1b-776a-426b-aa7f-53510f02ba9d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:26.467334 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Bound port: 181874e7-6fac-4648-9d3e-ed7f7c298702, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:26.467737 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.486185 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:26.505335 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group_rule and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:26.516580 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:26.528770 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:26.565739 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.757300 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.773882 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.784010 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:26.792846 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] For port 181874e7-6fac-4648-9d3e-ed7f7c298702, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:26.800688 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] For port 181874e7-6fac-4648-9d3e-ed7f7c298702, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=181874e7-6fac-4648-9d3e-ed7f7c298702,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:26.814203 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.816173 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 2, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:26.818622 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:26.830005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736b8f02-e1d4-41c4-b4cd-422f56c29285 req-76d57a60-fe01-409c-8c9b-58fdd356f7dd tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:26.850205 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Checking router: cdb694ee-b9bf-4ffe-895b-e76ca953be5d for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:27:26.850649 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Updating router cdb694ee-b9bf-4ffe-895b-e76ca953be5d port 07986231-dfc0-427e-81fe-e80e576bf2aa binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:27:26.863475 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-736b8f02-e1d4-41c4-b4cd-422f56c29285 req-76d57a60-fe01-409c-8c9b-58fdd356f7dd tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.2627542 May 20 20:27:26.962254 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b66d6728-64d9-4605-8228-cda0972eaca2,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:26.982457 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:26.985091 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5356684 May 20 20:27:26.989430 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 35670) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:26.990522 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:27.011280 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:27.039459 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-736b8f02-e1d4-41c4-b4cd-422f56c29285 req-844c1f35-bdbc-4d08-812a-003f46d5dc09 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1760817 May 20 20:27:27.056862 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:27.060843 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:27.084419 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:floatingip and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:27.098378 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:27.113434 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f169b1bd-2c89-4e3c-87d6-537c2b08b945 None None] Pushing event updated for resources: {'Port': ['ID=181874e7-6fac-4648-9d3e-ed7f7c298702,revision_number=4']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:27.116187 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:27.116842 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:27.153086 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:27.154956 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:27.189479 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-f169b1bd-2c89-4e3c-87d6-537c2b08b945 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.371s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:27.310330 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:27.375283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:27.547366 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:27.564932 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'Port': ['ID=a01ef44d-8f06-4963-aeb4-4bed7b67e7c2,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:27.584762 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-64c106fa-841e-4527-9203-f399ca86549b req-1bdd03bb-76b3-49d1-9810-847eecd9f174 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.3996542 May 20 20:27:27.593932 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:27.595405 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:27.625723 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:27.663248 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:27.664965 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.9385953 May 20 20:27:27.824790 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:28.142775 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35718) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:28.167746 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Allocated IP 172.27.3.95 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/0f641d27-b4f0-4fb1-a358-3b2af089c17f) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:28.247168 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:28.349782 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Transition to ACTIVE for port object 07986231-dfc0-427e-81fe-e80e576bf2aa will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:28.362167 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:28.373439 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7ef47c36-2e2b-415c-a399-3101680a38b1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:28.447212 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-f693522f-fc2d-42c7-add0-4931fdf26f0d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:28.495641 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:28.509402 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac092e1-f018-4777-8ec3-8d7182b77d28 req-e859a5aa-fd8e-4457-8cbb-967238af24a8 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:28.517184 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-f693522f-fc2d-42c7-add0-4931fdf26f0d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:28.521081 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4ac092e1-f018-4777-8ec3-8d7182b77d28 req-e859a5aa-fd8e-4457-8cbb-967238af24a8 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.2003140 May 20 20:27:28.530979 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-f693522f-fc2d-42c7-add0-4931fdf26f0d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1157054176&fields=id&tenant_id=d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 267 time: 0.1754727 May 20 20:27:28.539392 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:26Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:28.558449 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22b63a8-a401-4a6b-a761-4ede836f161f None None] The sync data for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi is: [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:26Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:27:28.608687 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:28.637218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:28.641240 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Usage tracker for resource:security_group_rule and tenant:48a1b56ab7604ee48e7b487e786eb9e2 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:28.644225 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:28.650537 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:28.818122 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1a3de0-6830-4574-8df4-9ab308bf0b24 None None] Pushing event updated for resources: {'Port': ['ID=07986231-dfc0-427e-81fe-e80e576bf2aa,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:28.888612 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-cf1a3de0-6830-4574-8df4-9ab308bf0b24 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.516s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:28.892442 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4ac092e1-f018-4777-8ec3-8d7182b77d28 req-2183427b-3e61-4163-8fc0-7468e147a34f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3703098 May 20 20:27:29.142188 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.268767 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-15dcc090-04ac-4713-8991-334dc1366e22 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:29.270965 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-15dcc090-04ac-4713-8991-334dc1366e22 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 817 time: 0.7380462 May 20 20:27:29.273184 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.287502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.337643 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:29.341858 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Attempting to bind port 07986231-dfc0-427e-81fe-e80e576bf2aa on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:29.342995 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Attempting to bind port 07986231-dfc0-427e-81fe-e80e576bf2aa by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:29.344399 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Attempting to bind port 07986231-dfc0-427e-81fe-e80e576bf2aa on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:29.353726 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f49f56c9-cae6-40a3-82fd-7de02ab5ea3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:29.372060 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:29.373016 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Checking segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:29.373803 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.375095 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Bound using segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:29.376881 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Bound port: 07986231-dfc0-427e-81fe-e80e576bf2aa, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:29.378973 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.442731 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9f4f22cd-bb93-4084-ae8c-79b17edef0d1 req-0c317b84-ad00-4e32-9303-f8e0b0a0e2d1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.3188734 May 20 20:27:29.467257 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-30789880-94ce-4c0b-8e98-3bedc9a79cf5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/quotas/d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 375 time: 0.1784685 May 20 20:27:29.497396 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 181874e7-6fac-4648-9d3e-ed7f7c298702 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:29.521358 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=48a1b56ab7604ee48e7b487e786eb9e2&name=default HTTP/1.1" status: 200 len: 2979 time: 1.3764722 May 20 20:27:29.523426 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35760) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:29.538974 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f0c4176-cce1-47ee-a1fa-c15912a642cd,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:29.601727 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:29.697573 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:29.700855 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:29.741289 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:29.779211 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'Port': ['ID=0f641d27-b4f0-4fb1-a358-3b2af089c17f,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:29.790584 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.453s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:29.849399 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.891396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.921144 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:29.948656 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-341b155d-cdc8-473f-bcd8-fd0377326005 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:29.965262 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] For port 07986231-dfc0-427e-81fe-e80e576bf2aa, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:29.977214 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] For port 07986231-dfc0-427e-81fe-e80e576bf2aa, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=07986231-dfc0-427e-81fe-e80e576bf2aa,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:29.993433 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:30.010147 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:30.077104 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:30.081768 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:30.081974 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 181874e7-6fac-4648-9d3e-ed7f7c298702 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:30.103138 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f0c4176-cce1-47ee-a1fa-c15912a642cd,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:30.111796 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:30.115635 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:30.116510 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 181874e7-6fac-4648-9d3e-ed7f7c298702 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:30.117116 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:30.118126 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2f0c4176-cce1-47ee-a1fa-c15912a642cd HTTP/1.1" status: 204 len: 168 time: 0.5911109 May 20 20:27:30.339457 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:30.357656 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2575e12-b4f3-45c2-86cb-c7a267f7cd6b req-a645ea52-c595-43db-8e60-b82dbeb56a86 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:30.360117 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b2575e12-b4f3-45c2-86cb-c7a267f7cd6b req-a645ea52-c595-43db-8e60-b82dbeb56a86 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.2003441 May 20 20:27:30.482008 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b2575e12-b4f3-45c2-86cb-c7a267f7cd6b req-00e92f50-214a-4792-88b0-f2c062bdfb2a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1129830 May 20 20:27:30.515745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-341b155d-cdc8-473f-bcd8-fd0377326005 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:30.517662 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-341b155d-cdc8-473f-bcd8-fd0377326005 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&fields=id HTTP/1.1" status: 200 len: 348 time: 0.9879255 May 20 20:27:30.543173 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:27:30.547681 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:27:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:30.769203 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1a3de0-6830-4574-8df4-9ab308bf0b24 None None] Pushing event updated for resources: {'Port': ['ID=07986231-dfc0-427e-81fe-e80e576bf2aa,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:30.774338 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-d5a83ff3-078b-4883-bd16-ae97f56fa0f2 service neutron] 10.222.0.82 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2181184 May 20 20:27:30.852154 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-cf1a3de0-6830-4574-8df4-9ab308bf0b24 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.853s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:31.035235 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-19ea9eb9-fe1d-4240-a9eb-0c0be704c77a req-90bc2586-5b70-49ec-ac63-7b3c28ca7b86 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.1563940 May 20 20:27:31.071346 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-469f5dbf-3178-461c-96fe-a811f93d4ad4 service neutron] 10.222.0.82 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2853930 May 20 20:27:31.160862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:31.178313 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:31.185900 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:31.217278 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:31.228531 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:27:31.264452 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:31.307429 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'Port': ['ID=0f641d27-b4f0-4fb1-a358-3b2af089c17f,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:31.318182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:31.326963 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:31.344790 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.3364127 May 20 20:27:31.465286 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35810) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:31.498817 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:31.514223 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 181874e7-6fac-4648-9d3e-ed7f7c298702, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=181874e7-6fac-4648-9d3e-ed7f7c298702,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:31.524217 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:31.537638 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-cf1a3de0-6830-4574-8df4-9ab308bf0b24 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:31.569904 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:31.585903 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Usage tracker for resource:security_group_rule and tenant:f085fec109954d379e80f157de38eb4f is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:31.599752 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:31.622198 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:31.927468 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 07986231-dfc0-427e-81fe-e80e576bf2aa up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:32.028082 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c49da509-1982-4a80-8d2f-99f0fff0ca7b req-eba700d2-70d5-4f4e-8a4f-7569cf1b3e27 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:32.029765 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c49da509-1982-4a80-8d2f-99f0fff0ca7b req-eba700d2-70d5-4f4e-8a4f-7569cf1b3e27 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.2444434 May 20 20:27:32.042019 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.065324 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0b3ff8fe-a8aa-45f2-829b-2d501f7a56ed req-1b2629a7-6620-4efa-b022-ebf5b6f72d7f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.3318913 May 20 20:27:32.076671 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.114715 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-91178136-447b-43ce-a0f0-cff73386aeee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:32.175690 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cdcaa1dc-3d09-41a1-a4d1-2c543d778ee2,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:32.182803 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:32.183195 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c49da509-1982-4a80-8d2f-99f0fff0ca7b req-bab21640-d88b-43b5-acec-d9be50eed77c tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1476688 May 20 20:27:32.242470 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=181874e7-6fac-4648-9d3e-ed7f7c298702,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:32.245411 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f085fec109954d379e80f157de38eb4f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7790592 May 20 20:27:32.248217 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 35850) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:32.254066 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.715s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:32.375144 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 07986231-dfc0-427e-81fe-e80e576bf2aa completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:32.382563 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 07986231-dfc0-427e-81fe-e80e576bf2aa triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:32.382942 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.414924 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-3d35fb5f-b58f-4ddd-866a-1da8880904c5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1865956538&fields=id&tenant_id=831701ab26e241d0ac004d15e3ea0632 HTTP/1.1" status: 200 len: 267 time: 0.1200292 May 20 20:27:32.418154 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.433139 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2f352a1c-bd7c-49a7-a76d-21f772c2b4cb req-d09e9f43-d98b-4ebf-b56a-9f9f347785c9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0714624 May 20 20:27:32.493880 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:29Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:27:32.506050 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.537443 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e486b31c-f490-41ac-b3e8-edc927c3a170 None None] The sync data for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi is: [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:29Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:27:32.569998 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.609702 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 07986231-dfc0-427e-81fe-e80e576bf2aa, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=07986231-dfc0-427e-81fe-e80e576bf2aa,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:32.614733 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.616801 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:32.714608 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=07986231-dfc0-427e-81fe-e80e576bf2aa,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:32.718166 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:32.757450 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-755549f2-f3e5-4680-ae0b-504f060e380e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:32.759224 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-755549f2-f3e5-4680-ae0b-504f060e380e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 810 time: 0.3294344 May 20 20:27:32.760324 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.765563 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-069a099f-d993-40fb-beb8-8257c8116ad1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:32.789213 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cdcaa1dc-3d09-41a1-a4d1-2c543d778ee2,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:32.797316 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:32.798729 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:32.800162 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cdcaa1dc-3d09-41a1-a4d1-2c543d778ee2 HTTP/1.1" status: 204 len: 168 time: 0.5509474 May 20 20:27:32.810101 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-91a2b3da-d8fa-498f-9270-4a84ac948828 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/quotas/831701ab26e241d0ac004d15e3ea0632 HTTP/1.1" status: 200 len: 375 time: 0.0356481 May 20 20:27:32.893825 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-3869bc85-90f0-4480-a381-50f76fb736c2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:32.932952 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-3869bc85-90f0-4480-a381-50f76fb736c2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:32.934827 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-3869bc85-90f0-4480-a381-50f76fb736c2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1235607 May 20 20:27:33.104186 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-076f33b2-e1b6-4b7e-9e2f-0a3df1389d72 service neutron] 10.222.0.82 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1517792 May 20 20:27:33.303132 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-6e801d54-da40-4643-850a-783d0f654228 service neutron] 10.222.0.82 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1988707 May 20 20:27:33.336500 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7518e0b6-f727-4444-91c5-62d4e38bc076 req-14107363-b2b2-4006-98d2-a58d4a4cb337 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.0882254 May 20 20:27:33.686025 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 07986231-dfc0-427e-81fe-e80e576bf2aa up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:33.731394 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2ac373f6-82fb-4908-8171-771fce5472ea req-447a76f1-d9bf-4e06-b7c4-ed47511324b2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0662909 May 20 20:27:33.771797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f958adb-f1d2-4ee1-9aeb-952294567d1d req-19c48706-2a28-4ef0-926b-06c740f5da91 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:33.773895 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7f958adb-f1d2-4ee1-9aeb-952294567d1d req-19c48706-2a28-4ef0-926b-06c740f5da91 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.1822560 May 20 20:27:33.890808 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 07986231-dfc0-427e-81fe-e80e576bf2aa triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:33.892087 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:33.947386 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-16239f71-f465-4a1a-804d-c64c1a07fb48 req-a09cf8cd-04f9-4f89-982e-93075aea7142 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.1224012 May 20 20:27:33.952014 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7f958adb-f1d2-4ee1-9aeb-952294567d1d req-534b9f60-20b4-414b-858b-10c6ac8263c7 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1705852 May 20 20:27:34.218030 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 181874e7-6fac-4648-9d3e-ed7f7c298702 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:34.399374 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 181874e7-6fac-4648-9d3e-ed7f7c298702 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:34.401252 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:34.607482 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-74249dc0-3612-43cc-ba30-980eff21500f req-aa1234e6-5306-4b56-b918-d12ea743ec15 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.0893352 May 20 20:27:34.768377 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4cf07e9d-16d6-4c49-8da8-b5167c3ce894 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:34.931549 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-740ec947-c678-47dc-8543-45e875c11ffd req-d2de51a2-04d8-428b-af8f-6c5173fc6124 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0467918 May 20 20:27:35.137249 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3fac2981-5cc8-4e0e-806a-e0b7ca67bc15 req-05c1d187-52c9-4380-9bbb-c2d2040d92f3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.0823793 May 20 20:27:35.179732 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ae9a98-72b8-455e-a99d-a5789ab386cc req-ffd25e32-0661-4d75-91e5-b31c8862000e tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:35.181913 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-32ae9a98-72b8-455e-a99d-a5789ab386cc req-ffd25e32-0661-4d75-91e5-b31c8862000e tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.1203289 May 20 20:27:35.258252 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-32ae9a98-72b8-455e-a99d-a5789ab386cc req-a55a39e3-de92-49ca-9e89-716e06156b1f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607929 May 20 20:27:35.810854 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bb638fc7-14bd-4833-b08a-ae31aabdcd22 req-b2873e1a-1302-48d8-b6b9-a4ac199d1cf8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.0497615 May 20 20:27:36.123503 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5cdca2d0-2b59-4fc8-95f9-c578446e4eda req-5f534ccf-c05d-44bb-a684-9ca3b46f5c96 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0473208 May 20 20:27:36.300309 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a8d65986-b384-4958-bbf3-2b68727b1cb4 req-9f0b5c4f-a1af-47bd-8340-351aa0872efe tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.0538285 May 20 20:27:36.487627 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c9834b1-b5f5-4a33-ac73-8990246f9223 req-94ddc8a5-61de-4bb5-8cf0-34608d79d587 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:36.495743 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0c9834b1-b5f5-4a33-ac73-8990246f9223 req-94ddc8a5-61de-4bb5-8cf0-34608d79d587 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.1171381 May 20 20:27:36.546010 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0c9834b1-b5f5-4a33-ac73-8990246f9223 req-fb5933d3-5688-45c0-ba0a-6f25c0282653 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493052 May 20 20:27:36.549243 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Request body: {'port': {'device_id': '5b632013-af77-4dad-bd6b-737939f436ec', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'admin_state_up': True, 'tenant_id': '6eec95c790c84cfc8a6a2fbd90bb926c'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:36.553794 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-ff7858b6-8cac-4b89-b6a4-b85b1adec8bc tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91645) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:27:36.554954 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-ff7858b6-8cac-4b89-b6a4-b85b1adec8bc tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.69 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0073290 May 20 20:27:36.841442 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:36.852395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Usage tracker for resource:port and tenant:6eec95c790c84cfc8a6a2fbd90bb926c is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:36.861743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:36.883072 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:36.909610 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Made reservation on behalf of 6eec95c790c84cfc8a6a2fbd90bb926c for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:36.914524 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:36.946850 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Request body: {'port': {'device_id': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:37.171655 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-30c70708-bd59-436e-953f-cfcb59a26c51 req-4fe56099-c580-42c1-b822-fd8a672c9f3b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.0544400 May 20 20:27:37.241397 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:37.276581 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Allocated IP 172.20.0.10 (2021d324-55d7-4959-b1a9-ee3e58b34538/8debe367-8908-48d3-a2e2-6afb3c3cda2a/63c8bac7-63aa-4297-9795-5ceadedcdeb4) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:37.285244 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:37.372801 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-32cdd28c-c8b6-49dc-84d0-3e74d285f810 req-98674595-7f97-4c59-ae06-d2bee8505564 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0711777 May 20 20:27:37.491775 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-f6c3e513-ad36-4d51-9746-35e7a51401e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:37.633383 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.69', 52498) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:37.820036 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5638ca1b-937f-459a-80b3-bc9351258006 req-d4aaa34d-c727-4d05-bafc-06146085264c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.2711837 May 20 20:27:37.946614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:37.988057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.002584 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:38.047997 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-9656a2d6-a47c-4498-95e9-a78ac39ff612 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:38.048698 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-9656a2d6-a47c-4498-95e9-a78ac39ff612 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:network {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:38.080646 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:38.088691 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:38.091394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:38.097725 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:38.098969 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.112466 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd105724-40b6-4f67-96f7-e0bfec6e250a req-20670004-7788-4e65-a99b-ec1fe24adf26 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:38.119433 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fd105724-40b6-4f67-96f7-e0bfec6e250a req-20670004-7788-4e65-a99b-ec1fe24adf26 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 931 time: 0.3485153 May 20 20:27:38.122704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event updated for resources: {'Port': ['ID=63c8bac7-63aa-4297-9795-5ceadedcdeb4,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:38.126010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:38.142110 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5974057 May 20 20:27:38.164136 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Request body: {'port': {'device_id': '5b632013-af77-4dad-bd6b-737939f436ec', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:38.165862 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-9656a2d6-a47c-4498-95e9-a78ac39ff612 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:network {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:38.166962 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-9656a2d6-a47c-4498-95e9-a78ac39ff612 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 817 time: 0.5325170 May 20 20:27:38.246620 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8898bc07-0bec-49b5-b671-821ceb98b64c {{(pid=91645) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:27:38.257566 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.259034 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.276022 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Transition to ACTIVE for port object 8898bc07-0bec-49b5-b671-821ceb98b64c will not be triggered until provisioned by entity L2. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:38.292793 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fd105724-40b6-4f67-96f7-e0bfec6e250a req-9df51846-9b49-440e-b2e0-d7541fe11114 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1721025 May 20 20:27:38.301754 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.309118 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:38.311610 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.332538 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36112) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:38.458806 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-286b0e25-a048-49af-af36-5797c53d02c7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:38.525015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.69', 52504) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:38.630495 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-286b0e25-a048-49af-af36-5797c53d02c7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:38.631635 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-286b0e25-a048-49af-af36-5797c53d02c7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 380 time: 0.4446805 May 20 20:27:38.665378 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-533f7073-4aa2-446c-87da-fe7829446413 req-be37bbb0-432e-4aee-be40-a6cd3c378707 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.2105391 May 20 20:27:38.671471 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Pushing event updated for resources: {'Port': ['ID=8898bc07-0bec-49b5-b671-821ceb98b64c,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:38.676823 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'port': {'device_id': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'admin_state_up': True, 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'security_groups': ['3dbb244a-aebf-4ce5-9550-40907a2dbee9']}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:38.703219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.703413 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.393s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:38.725402 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:38.743459 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Usage tracker for resource:security_group_rule and tenant:eafb62b051e64f0f9ede7c3e5263e2ec is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:38.749783 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:38.802594 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Attempting to bind port 8898bc07-0bec-49b5-b671-821ceb98b64c on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:38.802949 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Attempting to bind port 8898bc07-0bec-49b5-b671-821ceb98b64c by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '9fa7a75a-96c2-47f7-ab0c-41b383012256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 812, 'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1'}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:38.803289 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Attempting to bind port 8898bc07-0bec-49b5-b671-821ceb98b64c on network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:38.806721 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:38.820958 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Port 8898bc07-0bec-49b5-b671-821ceb98b64c on network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:27:38.821337 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Attempting to bind port 8898bc07-0bec-49b5-b671-821ceb98b64c on network ba53435e-5386-4ba1-ad63-6c40a6baa7a1 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:38.833324 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:38.833706 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Checking segment: {'id': '9fa7a75a-96c2-47f7-ab0c-41b383012256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 812, 'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:38.834427 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Bound using segment: {'id': '9fa7a75a-96c2-47f7-ab0c-41b383012256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 812, 'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1'} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:38.834866 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Bound port: 8898bc07-0bec-49b5-b671-821ceb98b64c, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9fa7a75a-96c2-47f7-ab0c-41b383012256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 812, 'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1'}}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:38.835317 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:38.853492 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-1811b982-c4e8-4f11-8e47-3995103d24d4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:38.854193 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-1811b982-c4e8-4f11-8e47-3995103d24d4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:network {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:38.938306 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd02814-261a-438c-b7f5-7dd307a7f07c req-5058d63c-cd43-4269-9a09-0db338da6afa tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:38.940073 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6bd02814-261a-438c-b7f5-7dd307a7f07c req-5058d63c-cd43-4269-9a09-0db338da6afa tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 932 time: 0.3505535 May 20 20:27:38.947677 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:38.994908 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:39.022493 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Made reservation on behalf of d5d038c87b86437990c22a9e55b308b6 for: {'port': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:39.025957 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.036377 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-1811b982-c4e8-4f11-8e47-3995103d24d4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:network {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:39.037502 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-1811b982-c4e8-4f11-8e47-3995103d24d4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 810 time: 0.4927917 May 20 20:27:39.043285 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] For port 8898bc07-0bec-49b5-b671-821ceb98b64c, host hv-cinder-78462, cleared binding levels {{(pid=91645) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:39.051172 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1d2ddefc-4008-4e68-b4d8-c65f162080fe req-aeb07dfd-1243-4658-b945-1ef6bf1cb896 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.0556810 May 20 20:27:39.063440 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-6bd02814-261a-438c-b7f5-7dd307a7f07c req-86184939-6faa-4274-90fc-7abeff870905 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:39.073605 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] For port 8898bc07-0bec-49b5-b671-821ceb98b64c, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8898bc07-0bec-49b5-b671-821ceb98b64c,segment=NetworkSegment(9fa7a75a-96c2-47f7-ab0c-41b383012256),segment_id=9fa7a75a-96c2-47f7-ab0c-41b383012256)] {{(pid=91645) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:39.126095 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.140146 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:39.193079 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.199893 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-de00ca15-a19d-4260-b1ce-c47802c2c0cd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:39.215472 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-6bd02814-261a-438c-b7f5-7dd307a7f07c req-86184939-6faa-4274-90fc-7abeff870905 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:39.216668 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6bd02814-261a-438c-b7f5-7dd307a7f07c req-86184939-6faa-4274-90fc-7abeff870905 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2647994 May 20 20:27:39.231282 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.237971 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:39.239440 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.241073 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] 10.222.0.69 "PUT /v2.0/ports/8898bc07-0bec-49b5-b671-821ceb98b64c HTTP/1.1" status: 200 len: 1093 time: 2.4066386 May 20 20:27:39.241874 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'tag': '8898bc07-0bec-49b5-b671-821ceb98b64c'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:27:39.247219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:39.258224 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-de00ca15-a19d-4260-b1ce-c47802c2c0cd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:39.260114 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-de00ca15-a19d-4260-b1ce-c47802c2c0cd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=831701ab26e241d0ac004d15e3ea0632 HTTP/1.1" status: 200 len: 380 time: 0.1992834 May 20 20:27:39.301058 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'port': {'device_id': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'admin_state_up': True, 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'security_groups': ['68f68b1b-776a-426b-aa7f-53510f02ba9d']}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:39.343295 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6236495a-fbe1-41b6-862e-1eb462a9b388,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:39.360266 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:39.381250 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=eafb62b051e64f0f9ede7c3e5263e2ec&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0434587 May 20 20:27:39.390343 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36158) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:39.409733 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Pushing event updated for resources: {'Port': ['ID=8898bc07-0bec-49b5-b671-821ceb98b64c,revision_number=3']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:39.419339 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.279s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:39.466380 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Allocated IP 172.20.0.5 (5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528/113ead2b-c65c-4cf9-b6ed-724ff34a0db1/80d1054a-94cc-4a2a-8c3e-af2e4e501ee6) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:39.488443 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-7174c416-5546-4431-af67-9f4f69e3162c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:39.491264 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-7174c416-5546-4431-af67-9f4f69e3162c service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=86c5233ea65940628ae25f1515bce737&device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 1096 time: 0.1809716 May 20 20:27:39.580879 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-e62b587e-a19d-4559-b3d1-28c01b7db0f7 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=8898bc07-0bec-49b5-b671-821ceb98b64c HTTP/1.1" status: 200 len: 217 time: 0.0772750 May 20 20:27:39.685987 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 63c8bac7-63aa-4297-9795-5ceadedcdeb4 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:27:39.710655 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.746894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:39.750655 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Transition to ACTIVE for port object 63c8bac7-63aa-4297-9795-5ceadedcdeb4 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:39.753009 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-3da7b3ea-49e8-4f3c-a6d9-a02d2b788229 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:39.755261 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-3da7b3ea-49e8-4f3c-a6d9-a02d2b788229 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=3305c376-fda9-4e41-a3fd-02e199629c67 HTTP/1.1" status: 200 len: 852 time: 0.1468797 May 20 20:27:39.782919 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.787314 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:39.828884 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:39.830255 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-2a799d49-874a-4a35-be7d-35f7fa20a04e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ba53435e-5386-4ba1-ad63-6c40a6baa7a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0609477 May 20 20:27:39.865631 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'tag': '8898bc07-0bec-49b5-b671-821ceb98b64c', 'status': 'completed', 'code': 200} May 20 20:27:39.877450 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.891376 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.898747 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9b6909-5b2b-4c67-9018-92a2cfbce488 req-0d3aec4a-b177-4f36-8690-91d30c8ad2bc tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:39.899950 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4d9b6909-5b2b-4c67-9018-92a2cfbce488 req-0d3aec4a-b177-4f36-8690-91d30c8ad2bc tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 943 time: 0.3380625 May 20 20:27:39.909916 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:39.962814 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36184) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:39.963857 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Transition to ACTIVE for port object 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 will not be triggered until provisioned by entity DHCP. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:39.999756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Made reservation on behalf of 831701ab26e241d0ac004d15e3ea0632 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:27:40.003466 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.069024 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1dc216c1-1a15-4cf2-9def-a8396ad67044 req-13e54520-c07a-4c45-aa7e-8139aa698031 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.0553806 May 20 20:27:40.070794 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-03618646-c8c7-4844-ae0c-2d7697079532 service neutron] 10.222.0.69 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2280202 May 20 20:27:40.071539 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.085416 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.106352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Pushing event updated for resources: {'Port': ['ID=63c8bac7-63aa-4297-9795-5ceadedcdeb4,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:40.123740 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:40.179057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.350s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:40.305197 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4d9b6909-5b2b-4c67-9018-92a2cfbce488 req-45840a2a-32cd-4494-b0ae-dcf246012ffa tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3852034 May 20 20:27:40.333550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Attempting to bind port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:40.334095 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Attempting to bind port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:40.334586 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Attempting to bind port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:40.336932 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.345998 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 on network 2021d324-55d7-4959-b1a9-ee3e58b34538 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:27:40.346533 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Attempting to bind port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:40.366008 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:40.366614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Checking segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:40.367321 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Bound using segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:40.367975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Bound port: 63c8bac7-63aa-4297-9795-5ceadedcdeb4, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:40.368319 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.416021 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:40.420134 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d0c8434f-781a-4a87-9b03-ecfb1dd260cd req-605ccf56-5e76-4ba2-9297-7624b802d4e2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.1402578 May 20 20:27:40.425074 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:40.445450 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:40.445544 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:40.446138 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.454372 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:40.472011 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Usage tracker for resource:security_group_rule and tenant:60691981ca394294bfb196e4dfb33bad is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:40.476004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:40.478518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:40.486074 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.362s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:40.489744 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:40.529079 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8635499 May 20 20:27:40.540736 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2702c25d-2d41-43c9-b60d-794eb4cda44e req-14e84511-ac96-4c78-a504-8c0840df03fa service neutron] 10.222.0.69 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4524205 May 20 20:27:40.546000 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.549499 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Request body: {'port': {'device_id': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:40.574638 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96e38f5c-6dfe-4728-92cc-e0ba846f8e4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:40.604493 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Allocated IP 172.20.0.13 (16b76e5b-322b-4d3c-b8d3-2d6888efd464/0f0b1ce3-e7c0-4e40-a18c-07e082124ea7/44f2b7d5-3bf8-4810-b1cf-0c839fe1827c) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:27:40.614247 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6236495a-fbe1-41b6-862e-1eb462a9b388,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:40.629491 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:40.679512 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] For port 63c8bac7-63aa-4297-9795-5ceadedcdeb4, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:40.700350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.701548 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6236495a-fbe1-41b6-862e-1eb462a9b388 HTTP/1.1" status: 204 len: 168 time: 1.2997124 May 20 20:27:40.717836 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.754569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-de0d89ff-9d9d-4e46-bfeb-7392e87e1321 None None] Provisioning for port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:40.761844 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-de0d89ff-9d9d-4e46-bfeb-7392e87e1321 None None] Provisioning complete for port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:40.762770 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-de0d89ff-9d9d-4e46-bfeb-7392e87e1321 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.844442 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-de0d89ff-9d9d-4e46-bfeb-7392e87e1321 None None] Port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:27:40.873439 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] For port 63c8bac7-63aa-4297-9795-5ceadedcdeb4, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:40.899455 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef6b80c9-94b8-4b97-af79-a094ed990db2 req-c905c5e5-1559-4633-98ae-e2f3f3f39eb3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:40.901018 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ef6b80c9-94b8-4b97-af79-a094ed990db2 req-c905c5e5-1559-4633-98ae-e2f3f3f39eb3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:40.907897 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.917815 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:40.934978 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:40.984926 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.019473 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:41.115581 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-40cd5e62-c55b-4bd0-be6c-dc7288982764 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:41.117677 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-40cd5e62-c55b-4bd0-be6c-dc7288982764 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=86c5233ea65940628ae25f1515bce737&device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 1096 time: 0.4020927 May 20 20:27:41.127048 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Pushing event updated for resources: {'Port': ['ID=63c8bac7-63aa-4297-9795-5ceadedcdeb4,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:41.132982 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=60691981ca394294bfb196e4dfb33bad&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1672506 May 20 20:27:41.157166 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ffabd5b-75e1-435b-af4b-a1fe9974a948,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:41.164729 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.165695 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36222) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:41.168449 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.170738 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:41.202466 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Transition to ACTIVE for port object 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:41.225583 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36226) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:41.230746 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:41.232371 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ef6b80c9-94b8-4b97-af79-a094ed990db2 req-c905c5e5-1559-4633-98ae-e2f3f3f39eb3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:41.239398 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ef6b80c9-94b8-4b97-af79-a094ed990db2 req-c905c5e5-1559-4633-98ae-e2f3f3f39eb3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 944 time: 0.7956197 May 20 20:27:41.263690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.279358 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.304879 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:41.305506 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.306902 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] 10.222.0.69 "PUT /v2.0/ports/63c8bac7-63aa-4297-9795-5ceadedcdeb4 HTTP/1.1" status: 200 len: 1094 time: 3.1481960 May 20 20:27:41.312871 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5b632013-af77-4dad-bd6b-737939f436ec', 'tag': '63c8bac7-63aa-4297-9795-5ceadedcdeb4'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:27:41.374463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:41.378099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d0a2681a-5381-4919-a55f-7b8f16a38af8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:41.465952 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Usage tracker for resource:security_group_rule and tenant:44d27c6bc3f346cba9804adc31e95fc1 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:41.487751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:41.500448 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.502774 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-24caa8ed-c292-4e68-b94b-c29bc6d38348 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:41.504519 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-24caa8ed-c292-4e68-b94b-c29bc6d38348 service neutron] 10.222.0.69 "GET /v2.0/networks?id=ba53435e-5386-4ba1-ad63-6c40a6baa7a1 HTTP/1.1" status: 200 len: 913 time: 0.3700087 May 20 20:27:41.511656 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:41.516814 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:27:41.524879 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:27:41.541946 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ef6b80c9-94b8-4b97-af79-a094ed990db2 req-da329a63-18b2-41a6-b0d8-dcdce84b3455 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3013213 May 20 20:27:41.548845 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:27:41.570629 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:41.571384 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.634750 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3646233 May 20 20:27:41.638188 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'Port': ['ID=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:41.641247 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:41.657553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Request body: {'port': {'device_id': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:27:41.660182 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-f210c488-3664-474f-8b07-9fe6bd91cb50 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=8898bc07-0bec-49b5-b671-821ceb98b64c HTTP/1.1" status: 200 len: 217 time: 0.1347308 May 20 20:27:41.676643 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-372a2be3-4d91-47d5-9530-dde5aafcacdd req-cbcde2e0-f55d-4ab5-bc1b-e2291401d71b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:41.677426 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-372a2be3-4d91-47d5-9530-dde5aafcacdd req-cbcde2e0-f55d-4ab5-bc1b-e2291401d71b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:41.682309 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.751489 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 {{(pid=91645) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:27:41.783662 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.810405 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-372a2be3-4d91-47d5-9530-dde5aafcacdd req-cbcde2e0-f55d-4ab5-bc1b-e2291401d71b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:41.811690 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-372a2be3-4d91-47d5-9530-dde5aafcacdd req-cbcde2e0-f55d-4ab5-bc1b-e2291401d71b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 931 time: 0.5404062 May 20 20:27:41.816621 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Transition to ACTIVE for port object 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 will not be triggered until provisioned by entity L2. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:41.820202 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-67100be9-6645-4fd8-aa04-29b24096aa5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:41.821644 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-67100be9-6645-4fd8-aa04-29b24096aa5c service neutron] 10.222.0.69 "GET /v2.0/subnets?id=3305c376-fda9-4e41-a3fd-02e199629c67 HTTP/1.1" status: 200 len: 852 time: 0.1414444 May 20 20:27:41.825181 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.836540 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-d7bc73cb-8335-4fa1-8178-34d8d7f40b86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:41.837859 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-d7bc73cb-8335-4fa1-8178-34d8d7f40b86 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 1097 time: 0.4195685 May 20 20:27:41.844886 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e08578e7-2f8e-43a9-93d0-d9599bce355b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:41.875192 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-b12ec245-b079-4430-9a43-01ae4333ba46 None None] Provisioning for port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:41.887315 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-b12ec245-b079-4430-9a43-01ae4333ba46 None None] Provisioning complete for port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:41.888059 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b12ec245-b079-4430-9a43-01ae4333ba46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:41.944879 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-9b326071-9c84-44cd-b167-a99e3a39b495 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4 HTTP/1.1" status: 200 len: 217 time: 0.0873098 May 20 20:27:41.953553 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-b12ec245-b079-4430-9a43-01ae4333ba46 None None] Port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:27:41.953764 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-f2b9f584-b107-48fc-8876-c3ad7f07a5c4 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ba53435e-5386-4ba1-ad63-6c40a6baa7a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1146712 May 20 20:27:41.969912 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.014189 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.047311 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.062888 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-372a2be3-4d91-47d5-9530-dde5aafcacdd req-f1b1c62a-853d-4523-bddf-0d5b2dfe7296 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2392104 May 20 20:27:42.098580 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.111236 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:42.126351 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:42.126830 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.067s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:42.128612 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-92fcf72c-3db6-4822-849b-fc44d1e9b60d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:42.152116 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c14d930-bf08-421b-be47-8cbe9fb84f38 req-c25dbf77-49c7-41ef-b3a6-d936e8bcdeb1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:42.153692 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4c14d930-bf08-421b-be47-8cbe9fb84f38 req-c25dbf77-49c7-41ef-b3a6-d936e8bcdeb1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 943 time: 0.4608366 May 20 20:27:42.161917 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-9fd8436a-0402-425c-b74b-79a4fa536e62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:42.163418 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-9fd8436a-0402-425c-b74b-79a4fa536e62 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.1777172 May 20 20:27:42.279944 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=44d27c6bc3f346cba9804adc31e95fc1&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0523994 May 20 20:27:42.288624 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-a8710f71-aae4-4cb8-9a1e-e9c9c9b31bc3 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0882761 May 20 20:27:42.289994 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36254) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:42.310890 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ffabd5b-75e1-435b-af4b-a1fe9974a948,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:42.330857 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0f42ee3-68b0-4012-a874-00eab4e14513,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:42.355729 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:42.362373 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.364564 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7ffabd5b-75e1-435b-af4b-a1fe9974a948 HTTP/1.1" status: 204 len: 168 time: 1.1962330 May 20 20:27:42.376369 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Attempting to bind port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:42.376905 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Attempting to bind port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:42.377404 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Attempting to bind port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:42.399005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:27:42.399648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Attempting to bind port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:42.400830 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:42.426346 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4c14d930-bf08-421b-be47-8cbe9fb84f38 req-3798c39f-8fba-43d4-a7e2-73441fc75c12 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2531450 May 20 20:27:42.439029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:42.439573 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Checking segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:42.440302 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Bound using segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:42.442042 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Bound port: 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:42.442732 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.482198 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-abbb6b9b-c76b-40b2-95f3-9537b896db29 service neutron] 10.222.0.69 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4595306 May 20 20:27:42.730029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8ac49bc-262e-4a4f-802d-702e634dee1b req-a98a6575-d835-4bd3-820b-bc199e271b8b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:42.732879 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b8ac49bc-262e-4a4f-802d-702e634dee1b req-a98a6575-d835-4bd3-820b-bc199e271b8b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 932 time: 0.4792984 May 20 20:27:42.739394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.749409 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, cleared binding levels {{(pid=91645) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:42.783901 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5b632013-af77-4dad-bd6b-737939f436ec', 'tag': '63c8bac7-63aa-4297-9795-5ceadedcdeb4', 'status': 'completed', 'code': 200} May 20 20:27:42.797739 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91645) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:42.802599 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-5c4ba841-ac4d-4bc4-b1fd-2da59f149b7e service neutron] 10.222.0.69 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2500658 May 20 20:27:42.842854 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.867385 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:42.877789 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.918186 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b8ac49bc-262e-4a4f-802d-702e634dee1b req-78609411-1985-4f4f-93a0-25bc7a437f26 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1763799 May 20 20:27:42.951686 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:42.952895 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:42.955004 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] 10.222.0.69 "PUT /v2.0/ports/80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 1093 time: 2.4115944 May 20 20:27:42.956141 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:27:43.007368 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-2878931a-f776-4842-a6d7-555737211389 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6570516 May 20 20:27:43.030496 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=3']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:43.040460 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:43.047311 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'status': 'completed', 'code': 200} May 20 20:27:43.170628 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-2a8a3154-e9b7-426e-8ce9-81312a73c709 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:43.172212 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-2a8a3154-e9b7-426e-8ce9-81312a73c709 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1096 time: 0.1287413 May 20 20:27:43.181846 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36296) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:43.247367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e633b0-7903-45d7-b3c2-d595b1843696 req-01bf7877-84f0-4519-a4d7-0c9754d19b2e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:43.249168 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-27e633b0-7903-45d7-b3c2-d595b1843696 req-01bf7877-84f0-4519-a4d7-0c9754d19b2e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 944 time: 0.3799880 May 20 20:27:43.286334 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.300255 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.330329 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-954366d5-e38d-450e-bb9a-f15d855d22ae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:43.340244 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-b92eb3c1-0e10-4815-82cb-0242c005fb57 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 217 time: 0.1368906 May 20 20:27:43.356354 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:43.368105 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:27:43.373828 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0f42ee3-68b0-4012-a874-00eab4e14513,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:43.387446 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a2f8d31-6c06-42c2-9cb6-ccc68f30767a req-4b50acaa-790c-4215-b9f9-480bf03eabce service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3552799 May 20 20:27:43.391643 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.405813 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Usage tracker for resource:security_group_rule and tenant:0a67971d0be9475fa8f92051ec1115a0 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:43.409379 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36302) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:43.412097 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:43.418330 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.420063 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c0f42ee3-68b0-4012-a874-00eab4e14513 HTTP/1.1" status: 204 len: 168 time: 1.0907679 May 20 20:27:43.423039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:43.439022 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:43.440159 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-27e633b0-7903-45d7-b3c2-d595b1843696 req-b3dfa210-9cb7-49ba-880a-4e87cf67d607 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1533141 May 20 20:27:43.448685 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Transition to ACTIVE for port object 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:27:43.462735 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.467240 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-c8468710-9961-4ac4-a8b0-487b35970f20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:43.468948 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-c8468710-9961-4ac4-a8b0-487b35970f20 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.1137836 May 20 20:27:43.471971 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:43.513968 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8898bc07-0bec-49b5-b671-821ceb98b64c details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:27:43.574672 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7aa548f-79b2-4053-b721-3627162cbcdd req-631ea660-9851-494f-8c00-1189dc78d776 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:43.581825 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d7aa548f-79b2-4053-b721-3627162cbcdd req-631ea660-9851-494f-8c00-1189dc78d776 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.2969003 May 20 20:27:43.639320 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.720555 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:43.743923 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Usage tracker for resource:security_group_rule and tenant:c2075974321b4c209bee360b3567f9c3 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:43.758386 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:43.782393 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d7aa548f-79b2-4053-b721-3627162cbcdd req-91138f73-1019-41ff-b156-5a426bab0999 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1983917 May 20 20:27:43.802935 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:43.832960 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8898bc07-0bec-49b5-b671-821ceb98b64c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8898bc07-0bec-49b5-b671-821ceb98b64c,segment=NetworkSegment(9fa7a75a-96c2-47f7-ab0c-41b383012256),segment_id=9fa7a75a-96c2-47f7-ab0c-41b383012256)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:43.874901 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-e5fc2e2e-6b2d-4a99-8eaa-e1f37899f217 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:43.876382 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '8898bc07-0bec-49b5-b671-821ceb98b64c', 'network_id': 'ba53435e-5386-4ba1-ad63-6c40a6baa7a1', 'port_id': '8898bc07-0bec-49b5-b671-821ceb98b64c', 'mac_address': 'fa:16:3e:4f:08:f1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 812, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3305c376-fda9-4e41-a3fd-02e199629c67', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:27:43.879358 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-e5fc2e2e-6b2d-4a99-8eaa-e1f37899f217 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.3863835 May 20 20:27:43.954463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Pushing event updated for resources: {'Port': ['ID=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:43.964698 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.493s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:43.974855 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.983430 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:43.996486 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.043612 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8898bc07-0bec-49b5-b671-821ceb98b64c {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:27:44.078619 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:44.085199 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8898bc07-0bec-49b5-b671-821ceb98b64c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8898bc07-0bec-49b5-b671-821ceb98b64c,segment=NetworkSegment(9fa7a75a-96c2-47f7-ab0c-41b383012256),segment_id=9fa7a75a-96c2-47f7-ab0c-41b383012256)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:44.095322 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.100422 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:44.169809 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0a67971d0be9475fa8f92051ec1115a0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9868691 May 20 20:27:44.212958 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36324) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:44.221166 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d98ae5f6-9502-487c-83ab-ecfcc9c44042,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:44.244205 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8898bc07-0bec-49b5-b671-821ceb98b64c,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:44.247672 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:44.285386 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Attempting to bind port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:27:44.285883 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Attempting to bind port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:27:44.286256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Attempting to bind port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:44.307264 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:27:44.307541 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Attempting to bind port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:27:44.330273 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 27, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:27:44.330875 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Checking segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:27:44.331462 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Bound using segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:27:44.333236 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Bound port: 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:27:44.336095 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.337615 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:44.341238 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-03452290-9ebd-4bbd-b6da-7ed59b57a50b service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4443257 May 20 20:27:44.387915 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bb4d5d-e566-467a-9296-27252742ccbe req-eba105a7-9f13-43b7-9fd6-9bbe58639a73 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:44.396195 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-34bb4d5d-e566-467a-9296-27252742ccbe req-eba105a7-9f13-43b7-9fd6-9bbe58639a73 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 944 time: 0.7069263 May 20 20:27:44.429412 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.460608 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.465847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-be025de4-b098-4239-84cc-261cacb78b35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:44.467312 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-be025de4-b098-4239-84cc-261cacb78b35 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 1097 time: 0.8820903 May 20 20:27:44.485722 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.495644 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:44.567668 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['8898bc07-0bec-49b5-b671-821ceb98b64c'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:27:44.655478 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-34bb4d5d-e566-467a-9296-27252742ccbe req-2a94b9a4-aa39-4c6c-92bf-430295099dbc tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2577138 May 20 20:27:44.657584 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.742979 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260d0753-dc55-4dfe-88f9-a768218c8aec req-970c3ded-17b7-4012-b388-48b072719031 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:44.755678 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] For port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:27:44.756021 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-260d0753-dc55-4dfe-88f9-a768218c8aec req-970c3ded-17b7-4012-b388-48b072719031 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.5802448 May 20 20:27:44.768756 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c2075974321b4c209bee360b3567f9c3&name=default HTTP/1.1" status: 200 len: 2979 time: 1.3503411 May 20 20:27:44.768756 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=756e6ff9-034f-4092-8610-25637f158fc8,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:44.773505 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36346) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:44.803963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:44.813634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] For port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:27:44.857147 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:44.913850 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:44.949320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-6afe78f6-ff97-4a3c-9db2-4268a6a65015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:44.950980 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-6afe78f6-ff97-4a3c-9db2-4268a6a65015 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 916 time: 0.4686825 May 20 20:27:44.959277 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d2e3ffe8-803a-48b8-a637-fc52217cc987 req-31e2d578-ef3c-4ffa-a490-491486e88913 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5868964 May 20 20:27:45.014279 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-260d0753-dc55-4dfe-88f9-a768218c8aec req-a8bf6c7a-3f1c-4f70-b7bf-0cac9a687fe8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2417948 May 20 20:27:45.044195 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:45.098491 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.099847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:45.101623 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] 10.222.0.69 "PUT /v2.0/ports/44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 1094 time: 3.4519861 May 20 20:27:45.103176 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-e6cfd28c-6f88-4b87-bbef-265c0baa5bd3 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4 HTTP/1.1" status: 200 len: 217 time: 0.1219280 May 20 20:27:45.103818 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:27:45.168643 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:45.253155 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-9ad31d6d-f85c-44c1-a30c-a9eee73d994a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.256975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:45.263244 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-9ad31d6d-f85c-44c1-a30c-a9eee73d994a service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1096 time: 0.2073860 May 20 20:27:45.328767 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Pushing event updated for resources: {'Port': ['ID=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:45.339579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.426s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:45.341140 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.037s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:45.353732 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-ae69b2d6-aadf-4c46-8410-e4fa9bd60e7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.355052 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-ae69b2d6-aadf-4c46-8410-e4fa9bd60e7a service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.2285457 May 20 20:27:45.355872 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:45.359122 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d98ae5f6-9502-487c-83ab-ecfcc9c44042 HTTP/1.1" status: 204 len: 168 time: 1.1306250 May 20 20:27:45.361062 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d98ae5f6-9502-487c-83ab-ecfcc9c44042,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:45.364960 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:45.423885 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-a8f8c879-b0a0-432a-9c5e-c8e6d4a36f5d service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0540957 May 20 20:27:45.434404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17dcac34-bd3c-425c-8c43-d258aedc3561 req-544417c5-64ff-460d-902c-3944b23c4ca1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.436078 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-17dcac34-bd3c-425c-8c43-d258aedc3561 req-544417c5-64ff-460d-902c-3944b23c4ca1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 944 time: 0.5844061 May 20 20:27:45.462164 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:45.477624 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3b1bdce0-40fd-4a3d-bb13-1db79290f90a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:45.497572 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:45.501480 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/756e6ff9-034f-4092-8610-25637f158fc8 HTTP/1.1" status: 204 len: 168 time: 0.7236521 May 20 20:27:45.555931 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=756e6ff9-034f-4092-8610-25637f158fc8,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:45.558290 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:45.574742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-4900558a-6f75-4fde-b2f9-71328c746617 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.576138 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-4900558a-6f75-4fde-b2f9-71328c746617 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1097 time: 0.3948176 May 20 20:27:45.611720 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ca1812-0b64-4142-b0e3-397ec6daeb4f req-dea79630-fe2c-45f4-aea5-bb4a6eae18e8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.613242 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-38ca1812-0b64-4142-b0e3-397ec6daeb4f req-dea79630-fe2c-45f4-aea5-bb4a6eae18e8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.3469319 May 20 20:27:45.666583 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-abe7c78b-7096-4d85-9faa-e168236c74d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.667995 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-17dcac34-bd3c-425c-8c43-d258aedc3561 req-07c7ef1a-ebdd-4d65-9e83-3c589168f31c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2087607 May 20 20:27:45.668116 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-abe7c78b-7096-4d85-9faa-e168236c74d8 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.2703278 May 20 20:27:45.673277 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-38ca1812-0b64-4142-b0e3-397ec6daeb4f req-4aa72b6c-b527-425d-9ac1-eb64bd23fdf8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502284 May 20 20:27:45.726542 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-c69654eb-63eb-443c-a6f1-632fdcecc06e service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2877672 May 20 20:27:45.741561 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'status': 'completed', 'code': 200} May 20 20:27:45.904585 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d4c978-7e9a-4945-a33a-cdeffd2d84e5 req-b9a4e268-f46d-4286-8bf6-091ca962fb29 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:45.906046 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-13d4c978-7e9a-4945-a33a-cdeffd2d84e5 req-b9a4e268-f46d-4286-8bf6-091ca962fb29 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 944 time: 0.0924585 May 20 20:27:45.955207 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-13d4c978-7e9a-4945-a33a-cdeffd2d84e5 req-66c308c4-badc-4f12-8591-8c8b50ea023b tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422313 May 20 20:27:45.961164 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36380) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:45.982681 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:46.001378 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:46.006078 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Usage tracker for resource:security_group_rule and tenant:a963b480eeeb455aab0428b4cd256014 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:46.008962 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:46.014845 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:46.128548 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:46.135853 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:46.166052 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6848a7f2-d6cc-449e-81b3-b3537e08d57e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:46.194453 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a963b480eeeb455aab0428b4cd256014&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2317801 May 20 20:27:46.197148 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36396) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:46.228711 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=095737d2-fdce-48a1-ad31-a3b68683c40c,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:46.246941 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:46.276607 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:46.298186 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f45e28-8c55-47f9-8f66-5b2fa11346dc req-ec368d74-8e75-4c3e-a84c-263539095db0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:46.299980 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-80f45e28-8c55-47f9-8f66-5b2fa11346dc req-ec368d74-8e75-4c3e-a84c-263539095db0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:27:46.308988 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:46.321383 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-80f45e28-8c55-47f9-8f66-5b2fa11346dc req-ec368d74-8e75-4c3e-a84c-263539095db0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:27:46.322848 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-80f45e28-8c55-47f9-8f66-5b2fa11346dc req-ec368d74-8e75-4c3e-a84c-263539095db0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.1275003 May 20 20:27:46.386769 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:46.391100 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-80f45e28-8c55-47f9-8f66-5b2fa11346dc req-a33f828d-59fe-4ecf-80ab-d88c92836ede tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546772 May 20 20:27:46.393598 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:46.404811 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=095737d2-fdce-48a1-ad31-a3b68683c40c,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:46.411382 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:46.412218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:46.413541 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/095737d2-fdce-48a1-ad31-a3b68683c40c HTTP/1.1" status: 204 len: 168 time: 0.2153869 May 20 20:27:46.900143 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b9f0e02-1437-4c43-9928-0f151ed349e1 req-d164a451-5899-49f2-8825-a5398d9cd17c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:46.901631 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0b9f0e02-1437-4c43-9928-0f151ed349e1 req-d164a451-5899-49f2-8825-a5398d9cd17c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0920327 May 20 20:27:46.915596 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bdb239f-055b-4803-9056-4d62c3c0c2c4 req-2bbfafe3-204f-48ea-9c39-295d2ceff991 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:46.917198 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5bdb239f-055b-4803-9056-4d62c3c0c2c4 req-2bbfafe3-204f-48ea-9c39-295d2ceff991 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 944 time: 0.0946207 May 20 20:27:46.934559 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 63c8bac7-63aa-4297-9795-5ceadedcdeb4 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:27:46.977481 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5bdb239f-055b-4803-9056-4d62c3c0c2c4 req-909baa7e-dc75-442b-8fad-30318ed82827 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529444 May 20 20:27:47.000330 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0b9f0e02-1437-4c43-9928-0f151ed349e1 req-4247eac6-9bfb-461a-8148-30267e906c61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0917640 May 20 20:27:47.188775 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 63c8bac7-63aa-4297-9795-5ceadedcdeb4, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:47.212862 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '63c8bac7-63aa-4297-9795-5ceadedcdeb4', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'port_id': '63c8bac7-63aa-4297-9795-5ceadedcdeb4', 'mac_address': 'fa:16:3e:6a:fa:1f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8debe367-8908-48d3-a2e2-6afb3c3cda2a', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:27:47.215133 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2867632c-d22e-4f9f-9232-ad681096a093 req-f043015d-3ae8-4ec6-8d9e-495d239bfaae tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:47.216730 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2867632c-d22e-4f9f-9232-ad681096a093 req-f043015d-3ae8-4ec6-8d9e-495d239bfaae tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 944 time: 0.1053789 May 20 20:27:47.280773 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.288376 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2867632c-d22e-4f9f-9232-ad681096a093 req-0724d831-0c09-41dc-86a7-f093622f0b89 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652447 May 20 20:27:47.301682 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 63c8bac7-63aa-4297-9795-5ceadedcdeb4 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:27:47.328901 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 63c8bac7-63aa-4297-9795-5ceadedcdeb4, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:47.334716 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.337099 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:47.359266 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36454) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:47.418670 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=63c8bac7-63aa-4297-9795-5ceadedcdeb4,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:47.432442 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:47.526933 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.543407 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:47.549387 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Usage tracker for resource:security_group_rule and tenant:c1897ac6a54b42f8bbc89c0abc1b7808 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:47.553016 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:47.563883 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:47.627266 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b722845-5e46-4e66-b2c5-cadf00b05ac2 req-8704b580-5761-4347-bc42-cd0b2adef71b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:47.628977 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7b722845-5e46-4e66-b2c5-cadf00b05ac2 req-8704b580-5761-4347-bc42-cd0b2adef71b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.1257560 May 20 20:27:47.685670 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.688333 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7b722845-5e46-4e66-b2c5-cadf00b05ac2 req-f0dbe8f2-b64f-40b8-ac74-4a1603f6cce6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525558 May 20 20:27:47.693391 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.703863 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:47.748617 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c1897ac6a54b42f8bbc89c0abc1b7808&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3878832 May 20 20:27:47.750258 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f8e6cf3-36f2-4569-b0e7-ffadab1b4db8,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:47.751368 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36474) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:47.763453 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:47.821620 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.848122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.904554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.909622 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:47.926864 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f8e6cf3-36f2-4569-b0e7-ffadab1b4db8,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:47.930782 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:47.932847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:47.935798 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3f8e6cf3-36f2-4569-b0e7-ffadab1b4db8 HTTP/1.1" status: 204 len: 168 time: 0.1810007 May 20 20:27:48.297086 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a65cd3-2f37-4ee2-8d6b-8cc6911c98bc req-ed8395fb-a306-4a92-ac4c-24c18902c6fd tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:48.307922 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-50a65cd3-2f37-4ee2-8d6b-8cc6911c98bc req-ed8395fb-a306-4a92-ac4c-24c18902c6fd tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.1946397 May 20 20:27:48.368977 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-50a65cd3-2f37-4ee2-8d6b-8cc6911c98bc req-b625f17f-fc61-4e58-a7b4-85a2b97e2fe3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598426 May 20 20:27:48.378639 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c4d174-baae-4df7-950e-899b6f4af07a req-907771bb-3480-40d7-909c-5dd6376e0fd1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:48.389147 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-58c4d174-baae-4df7-950e-899b6f4af07a req-907771bb-3480-40d7-909c-5dd6376e0fd1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.2083118 May 20 20:27:48.466305 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-58c4d174-baae-4df7-950e-899b6f4af07a req-8ad7e28e-e3f3-4fd3-9f6f-34abde872d15 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0681949 May 20 20:27:48.597169 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f0c258-64a1-4989-879e-776bd283aa9b req-89cf5849-786c-479c-b737-7060807a66d1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:48.599147 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-47f0c258-64a1-4989-879e-776bd283aa9b req-89cf5849-786c-479c-b737-7060807a66d1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 944 time: 0.0911424 May 20 20:27:48.653229 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-47f0c258-64a1-4989-879e-776bd283aa9b req-5ac305ae-82e6-43af-96cc-d3e3688cc828 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472648 May 20 20:27:48.881973 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76bf17ad-e781-4eb3-b657-3539c9d91d89 req-0cd6118e-ac35-490a-8a8a-648b63b60fbe tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:48.883597 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-76bf17ad-e781-4eb3-b657-3539c9d91d89 req-0cd6118e-ac35-490a-8a8a-648b63b60fbe tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.0867651 May 20 20:27:48.931798 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-76bf17ad-e781-4eb3-b657-3539c9d91d89 req-45c32527-dc2d-4392-a231-5999c3e2a9bf tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424423 May 20 20:27:49.594827 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e814e2-d671-4fe7-9cdf-a36dc38fc68f req-bfe6a78e-2c2c-45ff-a291-b59f1f252bc8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:49.596681 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-03e814e2-d671-4fe7-9cdf-a36dc38fc68f req-bfe6a78e-2c2c-45ff-a291-b59f1f252bc8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.1071682 May 20 20:27:49.654763 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-03e814e2-d671-4fe7-9cdf-a36dc38fc68f req-4bffab1b-eab0-4f78-8eb8-4892fe6b5b42 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499647 May 20 20:27:49.838992 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-e4d3bcd4-9d42-4067-9726-81a50a9dda6a service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 217 time: 0.0972285 May 20 20:27:49.876153 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-2874bd02-8e72-428e-984a-1dce30cf388b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 217 time: 0.1234658 May 20 20:27:49.979428 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ef192f-9225-4dad-94e1-f5cd5096d684 req-d9f8763c-f201-41fe-8eb2-ae054c9bcc18 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:49.986857 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-21ef192f-9225-4dad-94e1-f5cd5096d684 req-d9f8763c-f201-41fe-8eb2-ae054c9bcc18 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 944 time: 0.1712496 May 20 20:27:49.989319 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-1f1884cb-9202-4a5c-9186-290e4e415192 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:49.990586 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-1f1884cb-9202-4a5c-9186-290e4e415192 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.1402206 May 20 20:27:50.000511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5855dddb-59f5-4c88-8e3a-551bb2d40016 req-fd69e9d3-fddd-499a-bf74-d5344ad25d93 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:50.002114 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5855dddb-59f5-4c88-8e3a-551bb2d40016 req-fd69e9d3-fddd-499a-bf74-d5344ad25d93 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.3462300 May 20 20:27:50.027045 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-a207bc6a-0a2c-4b6c-a863-16f979f7fca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:50.028470 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-a207bc6a-0a2c-4b6c-a863-16f979f7fca1 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.1369290 May 20 20:27:50.094128 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6dcf2fc-8154-4ea0-bf02-c2477517a659 req-9f4267bb-e7a8-45d2-87ae-e69a3a205f6d service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2933249 May 20 20:27:50.099949 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-21ef192f-9225-4dad-94e1-f5cd5096d684 req-6be641d2-0e18-48f4-8672-9ea007fd121f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1094198 May 20 20:27:50.155651 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5855dddb-59f5-4c88-8e3a-551bb2d40016 req-ba2b2a9d-f002-42f5-8c08-00e3de3315db tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1005530 May 20 20:27:50.176804 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-49e2d068-2a04-41b7-a3a9-70d6c7f83d59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:50.178190 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-49e2d068-2a04-41b7-a3a9-70d6c7f83d59 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1369202 May 20 20:27:50.180325 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-a0624573-9faa-4f73-bd89-54b4c0e4dec6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:50.182068 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-a0624573-9faa-4f73-bd89-54b4c0e4dec6 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1762478 May 20 20:27:50.240056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:27:50.358667 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-5e4e1c52-dbea-46aa-848c-37d6aed55a83 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1514385 May 20 20:27:50.459736 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-e1ed455a-1d40-4642-88cb-bc5c71d5d0fc service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2547898 May 20 20:27:50.476658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d83f3f6-e81d-43cb-ab2f-2a315cfeb1e2 req-6c61b3ab-8faf-483c-8f72-0b865f2491a7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:50.478523 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3d83f3f6-e81d-43cb-ab2f-2a315cfeb1e2 req-6c61b3ab-8faf-483c-8f72-0b865f2491a7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.2098525 May 20 20:27:50.512389 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62dcb8a8-dac0-48e3-a441-f5f917485290 req-588c69d0-e36d-453a-b5f5-51b4a9d2aad2 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1414599 May 20 20:27:50.706273 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3d83f3f6-e81d-43cb-ab2f-2a315cfeb1e2 req-4421f84e-9a99-4aa8-b6ea-e414b10d3c07 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1992273 May 20 20:27:50.707925 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-49047c63-443b-47b9-b8f4-57198db7aae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:50.707925 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-49047c63-443b-47b9-b8f4-57198db7aae2 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1097 time: 0.1241131 May 20 20:27:50.749306 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7353228c-0fd2-4861-a8db-e721b111ce97 req-0726576b-f5d9-4141-92ea-4616985f90c8 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2660320 May 20 20:27:50.921908 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426eb13d-56a0-4428-9d7d-85b2b5a7ae90 req-0cd6ea77-1992-471a-8fed-6f821961fb1d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:50.923364 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-426eb13d-56a0-4428-9d7d-85b2b5a7ae90 req-0cd6ea77-1992-471a-8fed-6f821961fb1d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.1463721 May 20 20:27:50.971068 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-426eb13d-56a0-4428-9d7d-85b2b5a7ae90 req-f34fa9cd-ff8a-40c4-b4a0-471b480b8d6c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407445 May 20 20:27:51.282311 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303c34d3-eadc-4622-b0b2-0b4eb04d60f8 req-4d925c7e-ff33-4f0d-ad18-453f1fb7ed9f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:51.283751 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-303c34d3-eadc-4622-b0b2-0b4eb04d60f8 req-4d925c7e-ff33-4f0d-ad18-453f1fb7ed9f tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 944 time: 0.0818954 May 20 20:27:51.330722 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-303c34d3-eadc-4622-b0b2-0b4eb04d60f8 req-70f6063f-8df7-41f6-9cda-fb3ec06edddc tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410531 May 20 20:27:51.340562 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3321e7e9-9720-4605-b5d4-9b0b35dbff97 req-93438f79-9365-412f-8696-a1de882a3a9b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:51.342065 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3321e7e9-9720-4605-b5d4-9b0b35dbff97 req-93438f79-9365-412f-8696-a1de882a3a9b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0845227 May 20 20:27:51.389121 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3321e7e9-9720-4605-b5d4-9b0b35dbff97 req-901dbe9c-dc3c-4ade-8582-699ee043bb44 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390465 May 20 20:27:51.906221 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66318d28-9cae-4cc7-8bfe-7702d0c1ab53 req-f9eec7ae-8018-46d6-bc2a-4a30901ed26e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:51.906221 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-66318d28-9cae-4cc7-8bfe-7702d0c1ab53 req-f9eec7ae-8018-46d6-bc2a-4a30901ed26e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.0827689 May 20 20:27:51.950552 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-66318d28-9cae-4cc7-8bfe-7702d0c1ab53 req-981f6b31-a8d7-4ed8-9542-83597da93a10 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380802 May 20 20:27:52.154715 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d38c115-230d-4eb5-922f-a441a2550ed5 req-8f0ea6da-652a-494c-b0e1-591be513b3d0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:52.156239 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5d38c115-230d-4eb5-922f-a441a2550ed5 req-8f0ea6da-652a-494c-b0e1-591be513b3d0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.0777230 May 20 20:27:52.199915 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5d38c115-230d-4eb5-922f-a441a2550ed5 req-2c8e4acd-fd9f-4bc4-bee4-ebb069535fde tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368538 May 20 20:27:52.245020 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:27:52.342209 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8898bc07-0bec-49b5-b671-821ceb98b64c up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:52.388704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-37820537-ede4-4a5a-a025-dff76da7f030 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:52.390276 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-37820537-ede4-4a5a-a025-dff76da7f030 service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.1391971 May 20 20:27:52.425336 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:52.439034 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'port_id': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'mac_address': 'fa:16:3e:29:ca:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 840, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:27:52.513185 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:52.529470 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b4713d-ca4a-4b4b-9f1c-6c624b68e394 req-22f6ebb0-7a8e-44e0-9c80-9a2965df3cf6 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:52.531105 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d3b4713d-ca4a-4b4b-9f1c-6c624b68e394 req-22f6ebb0-7a8e-44e0-9c80-9a2965df3cf6 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 944 time: 0.0822563 May 20 20:27:52.532622 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:27:52.539024 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 8898bc07-0bec-49b5-b671-821ceb98b64c completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:52.549679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 8898bc07-0bec-49b5-b671-821ceb98b64c triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:52.550056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:52.581477 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:52.586806 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d3b4713d-ca4a-4b4b-9f1c-6c624b68e394 req-f24a1b7c-4eb6-4e06-931c-58a7c1f9708c tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479465 May 20 20:27:52.589750 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:52.595405 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39450ba3-5bb4-4947-8fbb-a74f795005b3 req-9a34a609-f513-4e33-b200-d7e36ac8330e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:52.596884 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-39450ba3-5bb4-4947-8fbb-a74f795005b3 req-9a34a609-f513-4e33-b200-d7e36ac8330e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0976038 May 20 20:27:52.598130 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-777a766f-ddf7-481a-bebd-52dd0346b34b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:52.644907 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-39450ba3-5bb4-4947-8fbb-a74f795005b3 req-6f0ba41b-efe0-4531-b580-76332eedcf8d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400233 May 20 20:27:52.682003 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:52.685197 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:52.736515 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:52.763140 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8898bc07-0bec-49b5-b671-821ceb98b64c'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:27:52.828950 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8898bc07-0bec-49b5-b671-821ceb98b64c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8898bc07-0bec-49b5-b671-821ceb98b64c,segment=NetworkSegment(9fa7a75a-96c2-47f7-ab0c-41b383012256),segment_id=9fa7a75a-96c2-47f7-ab0c-41b383012256)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:52.835644 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:52.837455 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-cf1a3de0-6830-4574-8df4-9ab308bf0b24 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:52.903860 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8898bc07-0bec-49b5-b671-821ceb98b64c,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:52.907332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:53.057516 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8898bc07-0bec-49b5-b671-821ceb98b64c', 'code': 200} May 20 20:27:53.138629 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e087708-7e9d-4c90-af09-75b54fdc7988 req-b0f3c48d-1c78-4c57-a454-771c6098a8ce tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:53.140126 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e087708-7e9d-4c90-af09-75b54fdc7988 req-b0f3c48d-1c78-4c57-a454-771c6098a8ce tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.0794246 May 20 20:27:53.184229 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e087708-7e9d-4c90-af09-75b54fdc7988 req-04671280-c30b-436c-be61-8adcc71c636d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378010 May 20 20:27:53.383352 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d5ca29-9f05-4591-ba6c-78493898d5c4 req-12d3e4a8-9d1b-43e0-9097-917cb98c2d41 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:53.384841 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-79d5ca29-9f05-4591-ba6c-78493898d5c4 req-12d3e4a8-9d1b-43e0-9097-917cb98c2d41 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.0787411 May 20 20:27:53.437183 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-79d5ca29-9f05-4591-ba6c-78493898d5c4 req-8d5d2743-cf6a-4f39-9d71-f6008db02494 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466218 May 20 20:27:53.775956 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae29b01-3a57-43b8-99ed-370a82b2cb2d req-746c5757-9874-4a7f-9ea7-57f1e0cda229 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:53.777317 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5ae29b01-3a57-43b8-99ed-370a82b2cb2d req-746c5757-9874-4a7f-9ea7-57f1e0cda229 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.0807526 May 20 20:27:53.822869 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5ae29b01-3a57-43b8-99ed-370a82b2cb2d req-332d9fb9-db4f-4abe-a14a-a41180273da1 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397122 May 20 20:27:53.838902 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09fb924a-2286-4702-901d-e4d5e001c38e req-cbffebb7-10e8-4e7b-828b-d7f4a420de1b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:53.840394 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-09fb924a-2286-4702-901d-e4d5e001c38e req-cbffebb7-10e8-4e7b-828b-d7f4a420de1b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.0836446 May 20 20:27:53.886407 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-09fb924a-2286-4702-901d-e4d5e001c38e req-e14210d0-fd91-4267-b5e8-cb5c4546f39c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398033 May 20 20:27:54.368979 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73984a3-aa83-4692-bb06-f06264ebad21 req-976edfbd-eb56-4c4d-8bd0-4100724348eb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:54.370412 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a73984a3-aa83-4692-bb06-f06264ebad21 req-976edfbd-eb56-4c4d-8bd0-4100724348eb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.0815501 May 20 20:27:54.415675 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a73984a3-aa83-4692-bb06-f06264ebad21 req-0e72ad69-c182-49d2-89a3-74be60a7acc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393867 May 20 20:27:54.624317 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5ad9cf-4825-4769-945e-a28e1c72e14d req-640734cb-5e7d-4970-82bf-72df09173fc4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:54.625687 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c5ad9cf-4825-4769-945e-a28e1c72e14d req-640734cb-5e7d-4970-82bf-72df09173fc4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.0808833 May 20 20:27:54.673529 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c5ad9cf-4825-4769-945e-a28e1c72e14d req-510a0933-f76b-4d82-92ab-ff4466165ff2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416358 May 20 20:27:54.903236 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-de70cc2c-2dbb-4f04-8468-8458236bbf59 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 217 time: 0.0643921 May 20 20:27:55.038732 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-7cece878-b006-4cec-aebd-64f295d12818 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:55.040189 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-7cece878-b006-4cec-aebd-64f295d12818 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.1232808 May 20 20:27:55.061900 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d939e848-a884-49bc-b7a8-d8570b87fab5 req-fc161f8f-dd70-4fa1-9cc1-5d6561c7c686 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:55.063308 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d939e848-a884-49bc-b7a8-d8570b87fab5 req-fc161f8f-dd70-4fa1-9cc1-5d6561c7c686 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.1110928 May 20 20:27:55.150494 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb4300c-5421-459e-bbdf-702bff3ea235 req-fb691dfb-c335-483f-8470-5a42351ded0f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:55.151998 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4fb4300c-5421-459e-bbdf-702bff3ea235 req-fb691dfb-c335-483f-8470-5a42351ded0f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.1439214 May 20 20:27:55.161750 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d939e848-a884-49bc-b7a8-d8570b87fab5 req-df0aa037-1155-4521-8d45-1ecabbbab945 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0920365 May 20 20:27:55.165633 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-c8e9a2a5-7d88-4f55-be60-1d654f158737 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:55.167076 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-c8e9a2a5-7d88-4f55-be60-1d654f158737 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 1098 time: 0.0968602 May 20 20:27:55.179369 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-0c706aec-b1e9-444c-9cd8-d40d99738fb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:55.181211 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-0c706aec-b1e9-444c-9cd8-d40d99738fb5 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1099613 May 20 20:27:55.224187 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:55.236795 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4fb4300c-5421-459e-bbdf-702bff3ea235 req-63f37733-7462-4a4b-a424-2b519f5ee47a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0687473 May 20 20:27:55.243833 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:55.247677 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Usage tracker for resource:security_group_rule and tenant:662e1cde39164a63aeb5236aaa4230dc is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:55.250550 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:55.258011 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:55.340249 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-6217fd26-6da8-40ff-91fd-91af8f0c9d02 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1438389 May 20 20:27:55.342589 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:55.346310 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:55.355864 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-cc820f2c-a82d-4f11-9308-1c6d6167f28b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:55.356098 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:27:55.384315 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=f0845015-2209-4376-a5e2-e25ce3dd2ac1,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:55.389178 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:55.392870 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f5d87365-fa10-44d2-a8f8-b71f714bf329 req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1937294 May 20 20:27:55.492790 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37ea37dd-60a8-408b-afb6-057c42701b5d req-42f0f6d7-7342-4673-a395-aa15394e0522 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1403067 May 20 20:27:55.639272 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc7d2f2e-9a3a-4f82-8a23-9af9e4bf5100 req-98c764a9-cebf-4186-bde8-fffb6fc0b8fe tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:55.640762 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dc7d2f2e-9a3a-4f82-8a23-9af9e4bf5100 req-98c764a9-cebf-4186-bde8-fffb6fc0b8fe tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.0922365 May 20 20:27:55.693574 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dc7d2f2e-9a3a-4f82-8a23-9af9e4bf5100 req-6dbf6644-d388-4d9a-b5f9-eb395ace4612 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407534 May 20 20:27:55.867412 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56f82e5-023e-40fa-8498-c38087523763 req-937e1d48-878d-43c2-89f8-c89abac2fcc0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:55.869036 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b56f82e5-023e-40fa-8498-c38087523763 req-937e1d48-878d-43c2-89f8-c89abac2fcc0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.0863707 May 20 20:27:55.916925 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b56f82e5-023e-40fa-8498-c38087523763 req-3559ae8c-0f26-4937-ab58-7905ef2486b1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420208 May 20 20:27:56.394418 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45e2bbe-1043-42d6-845b-b8e9540d2b4e req-5f526ea4-0518-4922-bf3f-61db6d31ea24 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:56.397066 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b45e2bbe-1043-42d6-845b-b8e9540d2b4e req-5f526ea4-0518-4922-bf3f-61db6d31ea24 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.1270683 May 20 20:27:56.456853 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b45e2bbe-1043-42d6-845b-b8e9540d2b4e req-43061cc9-b191-4742-91e1-82648370e8ae tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452456 May 20 20:27:56.508230 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9612c4e-3ded-4ec7-b3cf-85ef842be2ba req-372f3e6c-a760-43f5-87de-a54a795442f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:56.509699 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f9612c4e-3ded-4ec7-b3cf-85ef842be2ba req-372f3e6c-a760-43f5-87de-a54a795442f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.0914006 May 20 20:27:56.559438 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f9612c4e-3ded-4ec7-b3cf-85ef842be2ba req-5ffff233-5a2f-4693-95c2-a666d787bd9f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438163 May 20 20:27:56.835853 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 63c8bac7-63aa-4297-9795-5ceadedcdeb4 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:56.906581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:56.914227 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:56.914599 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:56.946305 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a16e64-6029-49e6-96a7-21d84351ed5c req-5940396a-2be4-4438-953f-35794868379b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:56.947842 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43a16e64-6029-49e6-96a7-21d84351ed5c req-5940396a-2be4-4438-953f-35794868379b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.1412141 May 20 20:27:57.006301 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43a16e64-6029-49e6-96a7-21d84351ed5c req-8e620b61-a53a-4876-b376-c9977dcda2bd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515308 May 20 20:27:57.059406 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.088976 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5b632013-af77-4dad-bd6b-737939f436ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63c8bac7-63aa-4297-9795-5ceadedcdeb4'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:27:57.115423 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 63c8bac7-63aa-4297-9795-5ceadedcdeb4, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:57.122163 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.123387 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:27:57.146166 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27937708-f58d-4ce8-a737-39bc69e4d2a2 req-f531214f-1a88-48dc-b5dd-51d2825a0a45 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:57.148719 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-27937708-f58d-4ce8-a737-39bc69e4d2a2 req-f531214f-1a88-48dc-b5dd-51d2825a0a45 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 945 time: 0.0904357 May 20 20:27:57.153705 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:57.154671 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36748) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:57.220490 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-27937708-f58d-4ce8-a737-39bc69e4d2a2 req-5d6e41ff-8be0-4176-b619-dc8e420a7276 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641341 May 20 20:27:57.228774 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b632013-af77-4dad-bd6b-737939f436ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63c8bac7-63aa-4297-9795-5ceadedcdeb4', 'code': 200} May 20 20:27:57.266803 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:27:57.278432 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:27:57.278827 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.311722 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.322873 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=63c8bac7-63aa-4297-9795-5ceadedcdeb4,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:57.328183 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:57.331875 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:57.336634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Usage tracker for resource:security_group_rule and tenant:e7a4bcde6fd44cf3b75053214aec2d22 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:57.339499 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:57.345036 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:57.405109 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.435046 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.439508 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.442790 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:27:57.447258 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.449184 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:57.450415 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:57.492668 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7543eecc-7a0e-495e-80a3-9cda6b93cc1f,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:57.495924 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:57.501390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36760) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:57.501923 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e7a4bcde6fd44cf3b75053214aec2d22&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3461025 May 20 20:27:57.519395 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:57.522890 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:57.569833 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.599834 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.668395 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.674371 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f50fdda1-7a6b-4f61-9c2e-fed621bcff97 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:57.695743 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7543eecc-7a0e-495e-80a3-9cda6b93cc1f,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:57.699060 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:57.716647 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:57.722020 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7543eecc-7a0e-495e-80a3-9cda6b93cc1f HTTP/1.1" status: 204 len: 168 time: 0.2187781 May 20 20:27:57.753488 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-996b1fcb-5489-46f6-9a6c-6a89f8b55530 req-aa1ce4e6-2af6-4429-bdc6-56429cc17089 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:57.755715 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-996b1fcb-5489-46f6-9a6c-6a89f8b55530 req-aa1ce4e6-2af6-4429-bdc6-56429cc17089 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.1582301 May 20 20:27:57.826754 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-996b1fcb-5489-46f6-9a6c-6a89f8b55530 req-165e8c49-af99-4a41-92bf-8c73910867f7 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619030 May 20 20:27:57.961461 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08fc65ab-56e3-49da-a033-b69258ce0d46 req-fc3103d8-c00a-4275-be57-b56bac051bc5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:57.969834 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-08fc65ab-56e3-49da-a033-b69258ce0d46 req-fc3103d8-c00a-4275-be57-b56bac051bc5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1257558 May 20 20:27:58.024507 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-08fc65ab-56e3-49da-a033-b69258ce0d46 req-109782d3-6605-40e2-9378-58b89346ebd1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537708 May 20 20:27:58.122810 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36788) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:58.140801 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.156196 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:58.160005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Usage tracker for resource:security_group_rule and tenant:28d481c9beab4ff6a1b0e53b7cc045f4 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:58.163172 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:58.169200 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:58.200802 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89d64abb-e4f1-4016-a186-d529a32ea962 req-f2fe6e89-ecc9-483e-9b70-4a660f23c75d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:58.208572 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-89d64abb-e4f1-4016-a186-d529a32ea962 req-f2fe6e89-ecc9-483e-9b70-4a660f23c75d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.0875399 May 20 20:27:58.258807 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-89d64abb-e4f1-4016-a186-d529a32ea962 req-9e367343-09bc-4907-bb5e-905713cac235 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493991 May 20 20:27:58.271298 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.275915 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.283135 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:58.322795 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe643225-d5d8-4d4d-ad30-4b8c27121d16,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:58.325871 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:58.335885 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36800) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:58.336004 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=28d481c9beab4ff6a1b0e53b7cc045f4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2120848 May 20 20:27:58.395318 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.428491 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.435565 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037e2136-cb6b-4560-8d87-6b7f6407dc66 req-d09f5c76-c8c9-4dca-9a2c-5a7a60eea8aa tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:58.437209 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-037e2136-cb6b-4560-8d87-6b7f6407dc66 req-d09f5c76-c8c9-4dca-9a2c-5a7a60eea8aa tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.0898402 May 20 20:27:58.488350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.494275 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:58.508074 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe643225-d5d8-4d4d-ad30-4b8c27121d16,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:58.513335 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:58.519047 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.520778 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fe643225-d5d8-4d4d-ad30-4b8c27121d16 HTTP/1.1" status: 204 len: 168 time: 0.1838236 May 20 20:27:58.562414 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-037e2136-cb6b-4560-8d87-6b7f6407dc66 req-a092f6ed-7492-45aa-882f-758c2f003cc0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177685 May 20 20:27:58.877753 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36816) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:58.896293 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:58.910733 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:27:58.914887 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Usage tracker for resource:security_group_rule and tenant:5ec46eca73f646548d7f2129e0428dc0 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:27:58.917947 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:27:58.923925 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:27:59.017751 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:59.022245 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:59.033439 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:59.042804 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72aebdc-e6eb-4a86-96b0-eb67868f832e req-0f8a0c4f-10f8-4a9b-9e39-0143e06f9285 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:59.044521 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e72aebdc-e6eb-4a86-96b0-eb67868f832e req-0f8a0c4f-10f8-4a9b-9e39-0143e06f9285 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.0845730 May 20 20:27:59.077082 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5ec46eca73f646548d7f2129e0428dc0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1982291 May 20 20:27:59.079599 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36824) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:27:59.083013 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f58951ad-c1b8-4dda-8c30-50773475ff4a,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:59.092695 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e72aebdc-e6eb-4a86-96b0-eb67868f832e req-caed64fd-00cc-4c11-a1cd-d25ab000e74c tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417843 May 20 20:27:59.096022 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:59.148699 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:59.208762 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:59.230251 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:27:59.276135 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'code': 200} May 20 20:27:59.288429 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd7af85-2eb3-42c9-8e67-3d153c50a9f0 req-a7dfaad5-ef4c-4072-b163-e877f199645e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:59.289923 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3fd7af85-2eb3-42c9-8e67-3d153c50a9f0 req-a7dfaad5-ef4c-4072-b163-e877f199645e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1219499 May 20 20:27:59.310036 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:59.315050 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c5a385eb-97c0-4476-95a8-2efcd22dcdf0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:27:59.333024 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f58951ad-c1b8-4dda-8c30-50773475ff4a,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:27:59.343037 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:27:59.358455 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3fd7af85-2eb3-42c9-8e67-3d153c50a9f0 req-07558453-bd2c-4441-b117-e702cb22ef5f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621428 May 20 20:27:59.359685 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:27:59.363361 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f58951ad-c1b8-4dda-8c30-50773475ff4a HTTP/1.1" status: 204 len: 168 time: 0.2800667 May 20 20:27:59.469335 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e8a11c3-a502-4f8e-901b-fc208e3a9a3a req-1a4abcaf-f49c-449d-afb0-1974c0281ce5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:59.470667 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4e8a11c3-a502-4f8e-901b-fc208e3a9a3a req-1a4abcaf-f49c-449d-afb0-1974c0281ce5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 944 time: 0.0818071 May 20 20:27:59.519220 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4e8a11c3-a502-4f8e-901b-fc208e3a9a3a req-6da3fe96-0499-4592-97bb-c6847d848d80 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418894 May 20 20:27:59.776784 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2158dbfd-d451-4aaa-815f-893516c22275 req-5744936c-be54-480b-bdc4-2c9c617e2e8b tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:27:59.778223 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2158dbfd-d451-4aaa-815f-893516c22275 req-5744936c-be54-480b-bdc4-2c9c617e2e8b tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.0927193 May 20 20:27:59.826743 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2158dbfd-d451-4aaa-815f-893516c22275 req-2b9070bc-4031-4e04-9ab4-7a2c30648740 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426099 May 20 20:28:00.088830 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:28:00.262197 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:00.277013 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'port_id': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'mac_address': 'fa:16:3e:20:e9:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 843, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:28:00.320558 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9847da7c-71b8-42f3-a4f4-57b3c3bd64ac req-85c22a3f-0c85-4aa2-b172-395567b47198 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:00.322159 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9847da7c-71b8-42f3-a4f4-57b3c3bd64ac req-85c22a3f-0c85-4aa2-b172-395567b47198 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.0979998 May 20 20:28:00.338074 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:00.356424 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:28:00.368733 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9847da7c-71b8-42f3-a4f4-57b3c3bd64ac req-153d5509-6fca-4f24-b34c-1897c6d0727e tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409603 May 20 20:28:00.375741 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:00.380746 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:00.382808 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:00.450332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:00.453309 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:00.558873 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d18f92e-d857-42a9-8b9c-608797fc7577 req-5f667bb3-0fd1-4e24-902e-4d4858b31256 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:00.560376 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9d18f92e-d857-42a9-8b9c-608797fc7577 req-5f667bb3-0fd1-4e24-902e-4d4858b31256 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0815487 May 20 20:28:00.605275 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9d18f92e-d857-42a9-8b9c-608797fc7577 req-55f0418e-914e-4f42-a10d-9cf7640ca4ae tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390306 May 20 20:28:00.716777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218075f6-c8db-403e-a65d-e9c8c35f1792 req-931b1ae2-b3e1-45d9-8bc8-f9468774cf7a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:00.718253 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-218075f6-c8db-403e-a65d-e9c8c35f1792 req-931b1ae2-b3e1-45d9-8bc8-f9468774cf7a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 945 time: 0.0809519 May 20 20:28:00.771611 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-218075f6-c8db-403e-a65d-e9c8c35f1792 req-707988c0-070a-4371-8c1f-f128901a042e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460327 May 20 20:28:00.846676 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 36894) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:00.995566 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:01.018264 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:01.024017 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Usage tracker for resource:security_group_rule and tenant:a3418483e97c4fc19342df5e8c20e6a3 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:01.027557 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:01.034570 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:01.072163 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5fb54b7-7005-49ff-987c-0bb4a8418ea2 req-efbb5131-3521-4ba9-aad0-72c6bbc0ff51 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:01.073511 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c5fb54b7-7005-49ff-987c-0bb4a8418ea2 req-efbb5131-3521-4ba9-aad0-72c6bbc0ff51 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.1388686 May 20 20:28:01.134193 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c5fb54b7-7005-49ff-987c-0bb4a8418ea2 req-e261beb8-a996-4c56-829f-849b9f92230a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544915 May 20 20:28:01.173366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:01.177068 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:01.184518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-60bd0e23-df21-4574-a414-340e5bf2960c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:01.227231 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a3418483e97c4fc19342df5e8c20e6a3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3794258 May 20 20:28:01.228609 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf72943e-ae34-4132-a9cd-079ce2eecb22,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:01.229910 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 36904) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:01.231366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:01.293002 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:01.317949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:01.370235 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:01.374221 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:01.387731 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf72943e-ae34-4132-a9cd-079ce2eecb22,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:01.390324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:01.392287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:01.400322 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bf72943e-ae34-4132-a9cd-079ce2eecb22 HTTP/1.1" status: 204 len: 168 time: 0.1690950 May 20 20:28:01.563326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19b29eb-00f7-4c1c-a44b-eb7a72910835 req-0d84b4e3-1025-467a-bdd0-0e05b1b59373 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:01.564835 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c19b29eb-00f7-4c1c-a44b-eb7a72910835 req-0d84b4e3-1025-467a-bdd0-0e05b1b59373 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.0823853 May 20 20:28:01.614226 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c19b29eb-00f7-4c1c-a44b-eb7a72910835 req-2090a44f-51b8-4fbd-b1e5-c72ff151899e tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417125 May 20 20:28:01.805415 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7242729-954c-466b-9f57-39e9ad136531 req-30bf0286-9348-4268-8b72-a1868f8bde64 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:01.807177 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d7242729-954c-466b-9f57-39e9ad136531 req-30bf0286-9348-4268-8b72-a1868f8bde64 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0895946 May 20 20:28:01.896842 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa9cde4-ad3a-46a8-80aa-4d0da1de7a27 req-a8884366-6370-4d74-8a29-0cb3cf1c3faf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:01.898381 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7fa9cde4-ad3a-46a8-80aa-4d0da1de7a27 req-a8884366-6370-4d74-8a29-0cb3cf1c3faf service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 1099 time: 0.1267200 May 20 20:28:01.912312 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d7242729-954c-466b-9f57-39e9ad136531 req-631a498e-356e-4515-a264-cf8afceafd1d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0995417 May 20 20:28:02.045563 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7fa9cde4-ad3a-46a8-80aa-4d0da1de7a27 req-60fca9af-2eec-4f67-b966-fa317eab2e5e service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1246893 May 20 20:28:02.082748 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb892d2-a7a4-4311-a7f0-ff3672b6f3f3 req-93e0a7c3-a0c9-4afc-b526-7f6099506326 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:02.088278 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-afb892d2-a7a4-4311-a7f0-ff3672b6f3f3 req-93e0a7c3-a0c9-4afc-b526-7f6099506326 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 945 time: 0.1286628 May 20 20:28:02.140579 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-afb892d2-a7a4-4311-a7f0-ff3672b6f3f3 req-7b1013b6-6cf3-482c-a22c-90be6bb04968 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492840 May 20 20:28:02.340244 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0517148c-f418-4da8-9f9f-fc529b2ff2be req-add57d6f-3cd8-4139-82d6-9ca4f173db9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:02.341703 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0517148c-f418-4da8-9f9f-fc529b2ff2be req-add57d6f-3cd8-4139-82d6-9ca4f173db9f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1098 time: 0.1403353 May 20 20:28:02.350329 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01eb74aa-65e3-444b-b873-444aca4a4bb4 req-598c190b-aa6c-4b91-abe0-0dd59688b95f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:02.351752 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-01eb74aa-65e3-444b-b873-444aca4a4bb4 req-598c190b-aa6c-4b91-abe0-0dd59688b95f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.1043966 May 20 20:28:02.364233 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['44f2b7d5-3bf8-4810-b1cf-0c839fe1827c'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:28:02.424694 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-01eb74aa-65e3-444b-b873-444aca4a4bb4 req-e401cf24-21dc-42da-813c-fc1e24d72687 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668118 May 20 20:28:02.478188 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-0517148c-f418-4da8-9f9f-fc529b2ff2be req-67c5bb20-1b54-4263-8686-c3b14d5e9c81 service neutron] Synchronizing usage tracker for tenant:662e1cde39164a63aeb5236aaa4230dc on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:02.493799 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-7c172d1a-0175-476e-ab46-5580e9cc939e service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1019750 May 20 20:28:02.496699 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-0517148c-f418-4da8-9f9f-fc529b2ff2be req-67c5bb20-1b54-4263-8686-c3b14d5e9c81 service neutron] Unset dirty status for tenant:662e1cde39164a63aeb5236aaa4230dc on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:02.497805 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0517148c-f418-4da8-9f9f-fc529b2ff2be req-67c5bb20-1b54-4263-8686-c3b14d5e9c81 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0959616 May 20 20:28:02.733681 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87856714-767f-4575-94ae-93e8cd11f19d req-f25a9740-7497-4e60-a857-206786d42222 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:02.735391 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-f25a9740-7497-4e60-a857-206786d42222 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=86c5233ea65940628ae25f1515bce737&device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 1098 time: 0.0808074 May 20 20:28:02.795817 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:28:02.814744 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb3ce106-2ae1-43ea-a14c-d3cf23566480 req-ddb45e85-6eee-45dc-a65d-02729530dd6a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:02.822485 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fb3ce106-2ae1-43ea-a14c-d3cf23566480 req-ddb45e85-6eee-45dc-a65d-02729530dd6a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.0960796 May 20 20:28:02.885826 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fb3ce106-2ae1-43ea-a14c-d3cf23566480 req-57791334-42bc-490b-9e90-eed152d0e266 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579934 May 20 20:28:02.945780 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87856714-767f-4575-94ae-93e8cd11f19d req-14d0175d-03ba-4d35-a544-d8cf6b13c502 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:02.947342 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-14d0175d-03ba-4d35-a544-d8cf6b13c502 service neutron] 10.222.0.69 "GET /v2.0/networks?id=ba53435e-5386-4ba1-ad63-6c40a6baa7a1 HTTP/1.1" status: 200 len: 913 time: 0.1690686 May 20 20:28:03.050023 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-a2dba5a5-923c-4c1e-93ef-a6fb30c82e13 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=8898bc07-0bec-49b5-b671-821ceb98b64c HTTP/1.1" status: 200 len: 217 time: 0.0837703 May 20 20:28:03.178244 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87856714-767f-4575-94ae-93e8cd11f19d req-750cb269-5155-4706-80a6-269e398ae057 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:03.179665 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-750cb269-5155-4706-80a6-269e398ae057 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=3305c376-fda9-4e41-a3fd-02e199629c67 HTTP/1.1" status: 200 len: 852 time: 0.1211374 May 20 20:28:03.205833 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55d66b0-b02d-4cfa-9767-648d70e11109 req-c915f53a-28a5-461f-a4e5-865f80a27e92 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:03.208240 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a55d66b0-b02d-4cfa-9767-648d70e11109 req-c915f53a-28a5-461f-a4e5-865f80a27e92 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1157906 May 20 20:28:03.268415 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-8a93eb72-c86c-4546-b932-f6cbe622365b service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ba53435e-5386-4ba1-ad63-6c40a6baa7a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0700850 May 20 20:28:03.357071 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a55d66b0-b02d-4cfa-9767-648d70e11109 req-b6c12add-e73e-4b72-8354-af90b0715f71 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1117802 May 20 20:28:03.398730 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8495679-e56f-4f82-b524-3b4a544609e3 req-05332d06-f2c0-4f5d-ac1e-f2f0d8024a6f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:03.406573 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a8495679-e56f-4f82-b524-3b4a544609e3 req-05332d06-f2c0-4f5d-ac1e-f2f0d8024a6f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 945 time: 0.1284835 May 20 20:28:03.485748 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a8495679-e56f-4f82-b524-3b4a544609e3 req-ab8b7010-e34f-4dc0-ba49-1fc913f4aff7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0765662 May 20 20:28:03.588973 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-b957d40e-213d-4b70-9a85-23b7a163b421 service neutron] 10.222.0.69 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2886093 May 20 20:28:03.802559 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87856714-767f-4575-94ae-93e8cd11f19d req-cebe79f9-dfeb-4a37-a52b-571d73eae1d7 service neutron] 10.222.0.69 "GET /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1679695 May 20 20:28:03.808615 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:03.811740 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6878025a-2ab8-4147-811e-accc2dd2cb57 req-b5eb700e-fd54-47b1-8e70-9cfff9a0ad63 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:03.820752 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6878025a-2ab8-4147-811e-accc2dd2cb57 req-b5eb700e-fd54-47b1-8e70-9cfff9a0ad63 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.2193682 May 20 20:28:03.873143 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6878025a-2ab8-4147-811e-accc2dd2cb57 req-6d433918-afda-4001-a65b-29749836482d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491095 May 20 20:28:03.921255 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:03.929645 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:03.930021 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:04.072571 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:04.103320 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:04.116909 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:04.123063 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:04.125701 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:04.167433 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'code': 200} May 20 20:28:04.200252 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:04.206447 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:04.623577 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24173e8a-ed9e-4de9-a5fa-bb2776471b30 req-050aadd3-d4dc-40b8-a3fc-7ad57495956f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:04.625660 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-24173e8a-ed9e-4de9-a5fa-bb2776471b30 req-050aadd3-d4dc-40b8-a3fc-7ad57495956f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1099 time: 0.1549499 May 20 20:28:04.642912 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf34fb6-076c-49c4-b62a-433d0baa8a51 req-6d3e9db7-8306-4770-b649-0c1b75fb6dd2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:04.650594 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dcf34fb6-076c-49c4-b62a-433d0baa8a51 req-6d3e9db7-8306-4770-b649-0c1b75fb6dd2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1437967 May 20 20:28:04.701028 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ce1b81-7339-4c16-94d9-3b9a4f6719d7 req-98298d35-425a-4fa5-983b-1a690f886cb2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:04.702646 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-35ce1b81-7339-4c16-94d9-3b9a4f6719d7 req-98298d35-425a-4fa5-983b-1a690f886cb2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0965643 May 20 20:28:04.737708 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dcf34fb6-076c-49c4-b62a-433d0baa8a51 req-1df562d0-b73a-4ca9-8493-2fedda366e3d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0859392 May 20 20:28:04.765291 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-24173e8a-ed9e-4de9-a5fa-bb2776471b30 req-1a11a44c-1264-46db-8827-52bd9d326907 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1115613 May 20 20:28:04.772348 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-705b805c-a612-4c4e-92c8-b78e0cc7bc4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:04.796596 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-35ce1b81-7339-4c16-94d9-3b9a4f6719d7 req-074a3cfb-6f63-4f7e-9103-b466638263af tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0860031 May 20 20:28:05.102222 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb5eab5-1a97-4720-8d4c-fece579308ef req-aa608815-2d65-4da8-8e44-28b25d55095a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:05.104428 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fdb5eab5-1a97-4720-8d4c-fece579308ef req-aa608815-2d65-4da8-8e44-28b25d55095a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.1093285 May 20 20:28:05.188189 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fdb5eab5-1a97-4720-8d4c-fece579308ef req-bbdad894-51fd-4715-9ec2-8dd74b58e359 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745916 May 20 20:28:05.956817 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd40798-c56a-4194-954e-03c46da97ef8 req-b9b46aa6-225a-44fc-8132-56f908f7bb2d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:05.958716 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1bd40798-c56a-4194-954e-03c46da97ef8 req-b9b46aa6-225a-44fc-8132-56f908f7bb2d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0860345 May 20 20:28:06.011973 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1bd40798-c56a-4194-954e-03c46da97ef8 req-f18476cb-8749-4c0f-8261-e4f57edb2539 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461218 May 20 20:28:06.012242 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-588245f2-0ddc-4bf2-a0d0-1213277906c4 req-5fb93bd7-3ba0-4d59-a70f-bb5e35360c03 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:06.016682 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-588245f2-0ddc-4bf2-a0d0-1213277906c4 req-5fb93bd7-3ba0-4d59-a70f-bb5e35360c03 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0926542 May 20 20:28:06.120007 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-588245f2-0ddc-4bf2-a0d0-1213277906c4 req-579c9753-73b6-40a8-94d9-d72b93a37996 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1005352 May 20 20:28:06.234307 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99e3e53f-885e-408c-81c9-1a640b3e2092 req-e262b687-63da-42ce-951a-178934898f66 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:06.236283 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-99e3e53f-885e-408c-81c9-1a640b3e2092 req-e262b687-63da-42ce-951a-178934898f66 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0880709 May 20 20:28:06.248603 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37098) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:06.255164 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'floatingip': {'port_id': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:06.334799 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:07.202287 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:07.238039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:07.242244 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:07.500582 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7ef63f40-5505-4f5c-b40a-5dd3545276e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:07.502150 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.l3_db [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Floating IP 1101f725-c21b-4379-8652-4a224ba3c1fd associated. External IP: 172.27.3.32, port: 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6. May 20 20:28:07.666481 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-246bb904-8914-4032-9312-e7e6cbb5216d req-3a08da53-3c4c-4d3a-b1fb-ef0dcc646f27 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:07.675447 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-246bb904-8914-4032-9312-e7e6cbb5216d req-3a08da53-3c4c-4d3a-b1fb-ef0dcc646f27 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.3759260 May 20 20:28:07.848281 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-246bb904-8914-4032-9312-e7e6cbb5216d req-989cb9ed-583f-42e6-8dbc-13b051388c56 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1710718 May 20 20:28:08.020150 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Router cdb694ee-b9bf-4ffe-895b-e76ca953be5d has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:28:08.223448 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b7ac0f-c712-41ef-8e54-25fd6b859bb7 req-4b2d7446-8d3e-4564-b738-9dee85ff5d30 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:08.229933 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c8b7ac0f-c712-41ef-8e54-25fd6b859bb7 req-4b2d7446-8d3e-4564-b738-9dee85ff5d30 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.2632446 May 20 20:28:08.239105 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37162) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:08.258944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'floatingip': {'port_id': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:08.263929 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:08.279984 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:08.306268 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] Sync routers for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:08.319657 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:08.320339 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:08.329435 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:08.423818 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:08.481167 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-50280eee-90e1-4e00-9e0f-073dac9f050c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "PUT /v2.0/floatingips/1101f725-c21b-4379-8652-4a224ba3c1fd HTTP/1.1" status: 200 len: 990 time: 2.2314565 May 20 20:28:08.486676 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:08.580163 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'status': 'completed', 'code': 200} May 20 20:28:08.638150 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:08.804857 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37184) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:08.873608 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-b8e0edc7-1d8f-49e5-aa11-acfdc33ef52f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:08.875548 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-b8e0edc7-1d8f-49e5-aa11-acfdc33ef52f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1098 time: 0.2640419 May 20 20:28:09.078783 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:09.091315 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-ddcf56fc-9437-40b0-acc1-7f5e89a382c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:09.093218 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-ddcf56fc-9437-40b0-acc1-7f5e89a382c4 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1997614 May 20 20:28:09.304275 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-a8911829-69f9-4a73-b01a-9cbc1807d147 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 998 time: 0.1899257 May 20 20:28:09.315130 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:09.327592 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Usage tracker for resource:security_group_rule and tenant:ee5c1e72367f4ef9bf3a3e344d1280d3 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:09.345401 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '1101f725-c21b-4379-8652-4a224ba3c1fd', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'floating_ip_address': '172.27.3.32', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'port_id': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'mac_address': 'fa:16:3e:29:ca:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:27:25Z', 'updated_at': '2021-05-20T20:28:07Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:09.353638 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:09.358631 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] Checking router: cdb694ee-b9bf-4ffe-895b-e76ca953be5d for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:09.373130 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:09.373923 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:09.392150 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-a6b019a0-9c28-444d-b4ca-634d20f66972 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:09.393858 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-a6b019a0-9c28-444d-b4ca-634d20f66972 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0678194 May 20 20:28:09.405532 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:09.522357 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37208) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:09.611232 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-97fce249-2e5a-4ee4-94f7-093d6ddf7517 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:09.614632 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-97fce249-2e5a-4ee4-94f7-093d6ddf7517 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.2033987 May 20 20:28:09.648793 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.db.resource_extend [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 20 20:28:09.656322 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:09.865020 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:09.879915 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-73aeb9d4-a6ca-46b0-a653-7b9819cdd2b1 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2480662 May 20 20:28:09.882589 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:09.887328 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:09.899892 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:09.920391 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Usage tracker for resource:security_group_rule and tenant:0e163808215b4dad8478950ccf9966a8 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:09.921833 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:09.928740 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:09.946135 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:10.065448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.088052 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9193b2b6-e2c0-424c-acd6-248d63cfa373 req-e2c238f8-193d-4c85-bdee-6a377cdda5e2 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1942327 May 20 20:28:10.136588 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.148600 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.155457 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.171323 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7f905cd2-4f55-481c-95da-3b89f54b898c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:10.176990 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:10.178173 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '1101f725-c21b-4379-8652-4a224ba3c1fd', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'floating_ip_address': '172.27.3.32', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'port_id': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'mac_address': 'fa:16:3e:29:ca:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:27:25Z', 'updated_at': '2021-05-20T20:28:07Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:10.182704 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a4d2424-d02c-4243-9b48-255f80588afc None None] The sync data for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi is: [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '1101f725-c21b-4379-8652-4a224ba3c1fd', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'floating_ip_address': '172.27.3.32', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'port_id': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'mac_address': 'fa:16:3e:29:ca:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:27:25Z', 'updated_at': '2021-05-20T20:28:07Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:10.193491 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ee5c1e72367f4ef9bf3a3e344d1280d3&name=default HTTP/1.1" status: 200 len: 2979 time: 1.3840127 May 20 20:28:10.198542 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37234) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:10.240396 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0e163808215b4dad8478950ccf9966a8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7155452 May 20 20:28:10.241628 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37238) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:10.249448 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Floating IP 8ecd567a-2a1f-4d10-88fd-79413207b227 associated. External IP: 172.27.3.95, port: 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c. May 20 20:28:10.281716 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8a0eeb8-e59b-434a-977b-e6ec5ebdbd16,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:10.320457 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.321068 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.321068 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.321507 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.321851 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.322189 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.322522 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.322852 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.323181 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.323506 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.323860 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.324185 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.335740 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:10.387579 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.390795 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de8522e1-0c80-49f4-9cac-11dfa204de45,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:10.410774 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.411132 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.411487 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.411885 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.412223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.412564 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.412902 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.413235 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.413576 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.413907 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.414239 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.414567 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:10.416880 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.429390 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:10.454031 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.487103 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a463495-138a-4f47-b326-b5ae106c3f0a None None] New status for floating IP 1101f725-c21b-4379-8652-4a224ba3c1fd: ACTIVE {{(pid=91647) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:28:10.495747 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.573892 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.580686 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:10.601276 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8a0eeb8-e59b-434a-977b-e6ec5ebdbd16,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:10.606337 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.608621 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:10.609092 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:10.632761 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.637615 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-372e0591-6d98-4421-bffe-9c23390a21b6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b8a0eeb8-e59b-434a-977b-e6ec5ebdbd16 HTTP/1.1" status: 204 len: 168 time: 0.3898609 May 20 20:28:10.638563 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de8522e1-0c80-49f4-9cac-11dfa204de45,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:10.651706 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:10.653899 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/de8522e1-0c80-49f4-9cac-11dfa204de45 HTTP/1.1" status: 204 len: 168 time: 0.4529111 May 20 20:28:10.659035 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:10.893435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:28:11.121631 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37278) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:11.147653 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.166127 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:11.170629 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Usage tracker for resource:security_group_rule and tenant:99eeb11f291f4dd987c650ec83721b14 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:11.173284 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:11.179151 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:11.206214 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:11.208115 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.217479 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] Sync routers for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:11.223792 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.235722 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:11.237002 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:11.266821 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.281924 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.287480 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-eb22eca7-38eb-42fe-99e5-7c88756cea4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "PUT /v2.0/floatingips/8ecd567a-2a1f-4d10-88fd-79413207b227 HTTP/1.1" status: 200 len: 991 time: 3.0461648 May 20 20:28:11.288463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:11.309389 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5fb6c7be-5571-45de-8be1-bd726218e054 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:11.346102 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=99eeb11f291f4dd987c650ec83721b14&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2262359 May 20 20:28:11.347022 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=427dceb8-30a1-4879-86e3-79861a3e7059,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:11.349440 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37294) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:11.365076 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:11.438247 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.477526 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.523084 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:11.546108 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.551426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:11.571470 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:11.574852 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/427dceb8-30a1-4879-86e3-79861a3e7059 HTTP/1.1" status: 204 len: 168 time: 0.2222266 May 20 20:28:11.582120 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=427dceb8-30a1-4879-86e3-79861a3e7059,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:11.587997 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:12.014789 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '8ecd567a-2a1f-4d10-88fd-79413207b227', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'floating_ip_address': '172.27.3.95', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'port_id': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'mac_address': 'fa:16:3e:20:e9:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:27:29Z', 'updated_at': '2021-05-20T20:28:09Z', 'revision_number': 1, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:12.020856 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] Checking router: e666c92f-d3d0-46f1-aeb9-c3dd182bf186 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:12.032190 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:12.033071 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:12.053130 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37330) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:12.072114 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:12.088142 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:12.093888 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Usage tracker for resource:security_group_rule and tenant:79ebd8e4989248bda62d7f5f244b2a33 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:12.097931 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:12.105275 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:12.225597 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:12.230088 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:12.239689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-efc86c6f-31ff-4950-9cc4-62383afce359 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:12.254778 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:12.283736 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=79ebd8e4989248bda62d7f5f244b2a33&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2293158 May 20 20:28:12.285465 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96c22a58-b6ef-4bcb-adf5-f2dc87815d14,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:12.286634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37340) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:12.306485 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:12.349991 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:12.376277 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:12.433325 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:12.438450 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cb108d79-201f-467b-9a86-28bac7f74d75 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:12.452642 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96c22a58-b6ef-4bcb-adf5-f2dc87815d14,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:12.455219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:12.456477 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:12.458106 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/96c22a58-b6ef-4bcb-adf5-f2dc87815d14 HTTP/1.1" status: 204 len: 168 time: 0.1705160 May 20 20:28:12.661017 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '8ecd567a-2a1f-4d10-88fd-79413207b227', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'floating_ip_address': '172.27.3.95', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'port_id': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'mac_address': 'fa:16:3e:20:e9:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:27:29Z', 'updated_at': '2021-05-20T20:28:09Z', 'revision_number': 1, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:12.666336 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab96d7e2-a36a-4492-94be-f1bfbce515a1 None None] The sync data for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi is: [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '8ecd567a-2a1f-4d10-88fd-79413207b227', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'floating_ip_address': '172.27.3.95', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'port_id': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'mac_address': 'fa:16:3e:20:e9:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:27:29Z', 'updated_at': '2021-05-20T20:28:09Z', 'revision_number': 1, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:12.937824 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4e0ae1e-2dd1-4c68-b93d-7d9582ce4f9c None None] New status for floating IP 8ecd567a-2a1f-4d10-88fd-79413207b227: ACTIVE {{(pid=91647) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:28:14.336870 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'status': 'completed', 'code': 200} May 20 20:28:14.471020 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafa6272-40c1-4869-8710-b60300a0fbad req-d732363c-fb9a-46aa-b037-66b990f8f3cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:14.473160 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eafa6272-40c1-4869-8710-b60300a0fbad req-d732363c-fb9a-46aa-b037-66b990f8f3cc service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1099 time: 0.0855625 May 20 20:28:14.641099 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafa6272-40c1-4869-8710-b60300a0fbad req-00ee0d31-657f-438d-9f6a-4acd5cb98949 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:14.642537 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eafa6272-40c1-4869-8710-b60300a0fbad req-00ee0d31-657f-438d-9f6a-4acd5cb98949 service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.1490741 May 20 20:28:14.756138 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eafa6272-40c1-4869-8710-b60300a0fbad req-6646600a-1920-420c-ba0f-c012af065ee2 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 1001 time: 0.0991352 May 20 20:28:14.824722 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafa6272-40c1-4869-8710-b60300a0fbad req-ead25322-2934-47bd-b868-83aaa6b23d50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:14.826228 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eafa6272-40c1-4869-8710-b60300a0fbad req-ead25322-2934-47bd-b868-83aaa6b23d50 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.0580320 May 20 20:28:14.996203 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafa6272-40c1-4869-8710-b60300a0fbad req-ed627b85-0d2d-4b05-b383-083d0f9f2bc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:14.997710 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eafa6272-40c1-4869-8710-b60300a0fbad req-ed627b85-0d2d-4b05-b383-083d0f9f2bc7 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1544652 May 20 20:28:15.136392 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eafa6272-40c1-4869-8710-b60300a0fbad req-a2977119-93b4-410c-80d4-af7546bdf54b service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266038 May 20 20:28:15.273285 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eafa6272-40c1-4869-8710-b60300a0fbad req-eab2840e-ea3d-4e96-8d98-765d2fbead1a service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1294255 May 20 20:28:17.256350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37508) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:17.388542 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:17.414678 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:17.421125 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Usage tracker for resource:security_group_rule and tenant:038faf26a4464ef1a3bccdf5dff02e5c is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:17.424799 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:17.434652 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:17.536018 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:17.540314 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:17.547909 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:17.592566 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=038faf26a4464ef1a3bccdf5dff02e5c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3348842 May 20 20:28:17.593725 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e8ccb6d-36f1-4153-95a2-824354b824eb,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:17.596292 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37526) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:17.597052 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:17.675149 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:17.708419 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:17.780025 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:17.785650 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:17.799958 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e8ccb6d-36f1-4153-95a2-824354b824eb,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:17.802819 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:17.813518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:17.817315 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6e8ccb6d-36f1-4153-95a2-824354b824eb HTTP/1.1" status: 204 len: 168 time: 0.2152917 May 20 20:28:18.163904 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37556) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:18.184513 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.203138 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:18.211283 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Usage tracker for resource:security_group_rule and tenant:1e4b80be734746f4ba9af6e53ada0b3c is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:18.214294 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:18.220154 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:18.235092 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3142807-a3e3-4ccf-afb5-341840916457 req-47071adc-81ad-4dd4-ae1c-39d4cf2350a0 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:18.236796 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f3142807-a3e3-4ccf-afb5-341840916457 req-47071adc-81ad-4dd4-ae1c-39d4cf2350a0 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.1203325 May 20 20:28:18.304461 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f3142807-a3e3-4ccf-afb5-341840916457 req-0a5243ca-a41e-42b4-a2e4-c1aa610b474a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599263 May 20 20:28:18.337629 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.341777 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.353673 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3e52526b-6753-4ae7-980d-0f067e446a89 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:18.412922 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1e4b80be734746f4ba9af6e53ada0b3c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2476978 May 20 20:28:18.413851 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b39e532e-9cb8-4c64-aa7c-9377d2cbf8ce,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:18.416914 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37566) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:18.417844 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:18.495091 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.522805 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.543268 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37572) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:18.559299 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37578) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:18.590619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.595853 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:18.608818 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b39e532e-9cb8-4c64-aa7c-9377d2cbf8ce,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:18.611793 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:18.621439 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.622878 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b39e532e-9cb8-4c64-aa7c-9377d2cbf8ce HTTP/1.1" status: 204 len: 168 time: 0.2044582 May 20 20:28:18.685030 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.702852 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:18.707665 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Usage tracker for resource:security_group_rule and tenant:8a5ee362477142bab1819d816078b1a5 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:18.707818 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.710620 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:18.716570 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:18.722283 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:18.728116 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Usage tracker for resource:security_group_rule and tenant:8077165c270041499a9ccc4056037c3d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:18.731286 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:18.737186 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:18.838900 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.841418 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.843441 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.846502 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:18.853850 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:18.855991 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8249d33c-d18f-46f3-8e6e-cd4c10fccef2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:18.883452 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da8799bf-3194-4215-85d2-1a9e4d6abdd8,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:18.899208 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:18.930931 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8a5ee362477142bab1819d816078b1a5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3861473 May 20 20:28:18.933387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37596) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:18.942215 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=653cc31a-b858-4e0f-8c2c-b7ac62a29396,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:18.947166 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:18.952002 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8077165c270041499a9ccc4056037c3d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3914797 May 20 20:28:18.956047 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37600) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:19.030721 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.048456 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.065929 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.080263 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.158320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.164204 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.170043 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-175d43e4-9060-48fd-bd69-cdebb15c453f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:19.173713 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bf607637-6004-4df2-a24f-edd886f1f622 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:19.183646 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da8799bf-3194-4215-85d2-1a9e4d6abdd8,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:19.187256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:19.188441 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.190309 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/da8799bf-3194-4215-85d2-1a9e4d6abdd8 HTTP/1.1" status: 204 len: 168 time: 0.2558873 May 20 20:28:19.195179 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=653cc31a-b858-4e0f-8c2c-b7ac62a29396,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:19.198974 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:19.213039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.215973 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/653cc31a-b858-4e0f-8c2c-b7ac62a29396 HTTP/1.1" status: 204 len: 168 time: 0.2567773 May 20 20:28:19.606932 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af88a5f-01ba-44f3-bb67-44833f2f6d96 req-5f30e98d-46fe-4390-98c8-3c28be1363d8 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:19.608496 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7af88a5f-01ba-44f3-bb67-44833f2f6d96 req-5f30e98d-46fe-4390-98c8-3c28be1363d8 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.1771722 May 20 20:28:19.665418 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7af88a5f-01ba-44f3-bb67-44833f2f6d96 req-ed2f0b21-2cf7-46db-bf73-5c246b1afaa2 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500751 May 20 20:28:19.722043 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37658) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:19.742331 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.759189 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:19.763275 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Usage tracker for resource:security_group_rule and tenant:5caa5e6039f74e9bb57e3348a7e93c33 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:19.766478 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:19.773021 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:19.874087 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.880963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:19.889587 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-115d75d3-a6d4-44b7-9498-6888a28ca1ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:19.933505 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5caa5e6039f74e9bb57e3348a7e93c33&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2074826 May 20 20:28:19.933505 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c265f6cd-16e4-4075-ac73-f11cad99bb7b,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:19.933688 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37666) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:19.935847 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:20.004691 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.047153 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.108640 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37678) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:20.130618 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.136748 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-39004c84-da0f-4acb-a0d1-c6cb82b34e76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:20.151177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c265f6cd-16e4-4075-ac73-f11cad99bb7b,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:20.153614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:20.162057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.165921 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c265f6cd-16e4-4075-ac73-f11cad99bb7b HTTP/1.1" status: 204 len: 168 time: 0.2312465 May 20 20:28:20.265376 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.281815 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:20.286087 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Usage tracker for resource:security_group_rule and tenant:3fff8927f33247509aaa0bf8b643ed61 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:20.289033 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:20.295094 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:20.392979 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.401779 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.444533 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6a288b66-10bc-44bc-b3b9-7c3330ae3733 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:20.480393 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37720) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:20.481104 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3fff8927f33247509aaa0bf8b643ed61&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3767455 May 20 20:28:20.482207 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ccfe5a3-2a3b-4867-a277-706e28819cf6,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:20.485757 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:20.556704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.592396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.668119 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.673644 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d374489a-bf87-491e-bcf1-7f457d747dba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:20.690215 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ccfe5a3-2a3b-4867-a277-706e28819cf6,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:20.692916 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37752) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:20.709750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:20.718623 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:20.723024 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8ccfe5a3-2a3b-4867-a277-706e28819cf6 HTTP/1.1" status: 204 len: 168 time: 0.2412391 May 20 20:28:20.992998 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77546fb-535e-4e7b-ad16-15c987b68bda req-6e1bbf1a-8f25-4850-831f-e3e93484c9e7 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:20.994482 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d77546fb-535e-4e7b-ad16-15c987b68bda req-6e1bbf1a-8f25-4850-831f-e3e93484c9e7 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.1827860 May 20 20:28:21.055096 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d77546fb-535e-4e7b-ad16-15c987b68bda req-95e4537f-6f97-45b1-b599-6d564b752e6d tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531883 May 20 20:28:21.077620 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-693066299-network', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:21.083004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:21.087133 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Usage tracker for resource:network and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:21.089932 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:21.098312 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:21.117088 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Made reservation on behalf of bf9ff50b3c4f4f7e8afcf9c87cade238 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:21.119591 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.143600 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.163551 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:21.167751 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:21.171468 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:21.180370 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:21.364529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37778) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:21.368849 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.385866 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.388187 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.393911 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-35613fc4-9a0b-4122-9857-bb0f9aed4f54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:21.407942 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:21.412831 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Usage tracker for resource:security_group_rule and tenant:69f863d8efb44089844d58ac6ab1c6d6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:21.420944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:21.428810 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:21.432946 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] vlan segment allocate from pool success with {'vlan_id': 849, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:28:21.436513 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0786391d-607b-4366-9ff1-7f12a0b96e13,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:21.446085 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:21.461385 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-ab7583c7-9cac-433a-af94-c01be3c92279 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:21.462777 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-ab7583c7-9cac-433a-af94-c01be3c92279 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.69 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.1764288 May 20 20:28:21.463897 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.464354 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Added segment 4626296e-819f-49b9-8f67-944cc7c115da of type vlan for network 9c4884cd-a197-48ab-a497-3c07afe55035 May 20 20:28:21.523968 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.528664 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.539896 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fd8e660a-cfa2-4e62-a82b-ee6f0b79d370 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:21.558926 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.580683 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3dbdda16-1d49-47b4-a075-f3f41773aab0,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:21.585254 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:21.591827 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=69f863d8efb44089844d58ac6ab1c6d6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2258348 May 20 20:28:21.594626 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37788) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:21.657252 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.660745 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:21.661341 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.667101 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c41a463b-8e82-4198-a8b0-020297a1c838 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:21.669866 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.700934 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.771793 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.777947 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:21.783230 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Deleting port 8898bc07-0bec-49b5-b671-821ceb98b64c {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:28:21.783589 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.804474 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Pushing event updated for resources: {'Network': ['ID=9c4884cd-a197-48ab-a497-3c07afe55035,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:21.817240 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dbdda16-1d49-47b4-a075-f3f41773aab0,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:21.821151 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:21.827059 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:21.843625 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.850515 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3dbdda16-1d49-47b4-a075-f3f41773aab0 HTTP/1.1" status: 204 len: 168 time: 0.2508860 May 20 20:28:21.853684 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 9c4884cd-a197-48ab-a497-3c07afe55035 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:28:21.892513 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.1984763 May 20 20:28:21.896540 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37812) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:21.902528 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Request body: {'subnet': {'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-693066299-subnet', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:21.911516 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:21.921553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Usage tracker for resource:subnet and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:21.932366 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:21.951839 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:21.989341 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Made reservation on behalf of bf9ff50b3c4f4f7e8afcf9c87cade238 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:21.990423 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] For port 8898bc07-0bec-49b5-b671-821ceb98b64c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8898bc07-0bec-49b5-b671-821ceb98b64c,segment=NetworkSegment(9fa7a75a-96c2-47f7-ab0c-41b383012256),segment_id=9fa7a75a-96c2-47f7-ab0c-41b383012256)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:21.990790 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:21.992258 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Notify callbacks [] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:22.318200 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Calling delete_port for 8898bc07-0bec-49b5-b671-821ceb98b64c owned by compute:nova {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:28:22.508390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae21a1f8-1570-4650-be50-cf0058eee3b4 req-406c03bf-2bf1-4b6f-a121-2a604c9ffcbd tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:22.509908 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ae21a1f8-1570-4650-be50-cf0058eee3b4 req-406c03bf-2bf1-4b6f-a121-2a604c9ffcbd tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 945 time: 0.2010784 May 20 20:28:22.566171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:22.571238 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c713bf0f-1699-42a0-858e-db608121611c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:22.618238 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ae21a1f8-1570-4650-be50-cf0058eee3b4 req-674a9437-bc70-4b3f-a8b6-26c877e96430 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/security-groups?id=986983b6-1bd7-49d6-9a19-3836f95202fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0992949 May 20 20:28:22.647113 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:22.656110 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:22.707576 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Pushing event deleted for resources: {'Port': ['ID=8898bc07-0bec-49b5-b671-821ceb98b64c,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:22.715520 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:22.716247 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Pushing event updated for resources: {'Subnet': ['ID=845e6d5e-4ee4-43a5-a910-0fd3f1657178,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:22.719867 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:22.737055 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Checking segment: {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:22.737579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Network hostable DHCP agents. Network: 9c4884cd-a197-48ab-a497-3c07afe55035, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:28:22.771450 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Network 9c4884cd-a197-48ab-a497-3c07afe55035 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:28:22.808146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 9c4884cd-a197-48ab-a497-3c07afe55035) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:22.810121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] No DVR routers for this DVR port 8898bc07-0bec-49b5-b671-821ceb98b64c on host hv-cinder-78462 {{(pid=91645) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:28:22.813593 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:22.814219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:22.818993 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d63e6a01-34e2-42b4-b9c8-b423913c9feb None None] Network 9c4884cd-a197-48ab-a497-3c07afe55035 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:22.823813 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:22.826645 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'name': 'network-vif-deleted', 'tag': '8898bc07-0bec-49b5-b671-821ceb98b64c'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:22.848950 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cb132485-44be-4073-8b9f-9b5182e4bb99 req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.69 "DELETE /v2.0/ports/8898bc07-0bec-49b5-b671-821ceb98b64c HTTP/1.1" status: 204 len: 173 time: 1.3758135 May 20 20:28:22.895919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37850) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:22.896244 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-46afab1e-68bb-4f05-8498-7f894313b1cd admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.9983454 May 20 20:28:22.901895 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:22.923881 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:22.939444 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '124e82f2-3e82-446a-b1c1-e7930a58d879', 'name': 'network-vif-deleted', 'tag': '8898bc07-0bec-49b5-b671-821ceb98b64c', 'status': 'completed', 'code': 200} May 20 20:28:22.941276 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Usage tracker for resource:router and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:22.949404 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:22.968236 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:22.984470 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:22.985689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.007441 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.195279 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-9c4884cd-a197-48ab-a497-3c07afe55035', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:28:23.196229 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.345881 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.416808 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Allocated IP 172.20.0.2 (9c4884cd-a197-48ab-a497-3c07afe55035/845e6d5e-4ee4-43a5-a910-0fd3f1657178/b29eaf10-987b-4e3f-96b8-bb2cc38ba477) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:23.715156 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.743859 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Transition to ACTIVE for port object b29eaf10-987b-4e3f-96b8-bb2cc38ba477 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:23.764520 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.806708 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.811092 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Transition to ACTIVE for port object b29eaf10-987b-4e3f-96b8-bb2cc38ba477 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:23.822013 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:23.833281 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:23.958973 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8898bc07-0bec-49b5-b671-821ceb98b64c no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:28:23.966462 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d4ec71f3-b3b5-46b4-975f-05cc9788e24a req-fae76b75-3a35-4abf-a369-5677d5937aa0 tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] 10.222.0.82 "GET /v2.0/ports?device_id=124e82f2-3e82-446a-b1c1-e7930a58d879 HTTP/1.1" status: 200 len: 210 time: 0.0762944 May 20 20:28:23.981297 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Allocated IP 172.27.3.90 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/02de7cb4-1bc7-4e00-884a-b24a3093df70) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:24.015689 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Network 9c4884cd-a197-48ab-a497-3c07afe55035 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:24.016865 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 8898bc07-0bec-49b5-b671-821ceb98b64c {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:28:24.017379 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8898bc07-0bec-49b5-b671-821ceb98b64c not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:28:24.022493 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:24.026889 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:24.068559 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Pushing event updated for resources: {'Port': ['ID=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:24.114031 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.114631 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.115119 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.115587 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.116133 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.116639 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.117111 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.117580 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.118061 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.118542 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.119161 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.119483 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:24.127113 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:24.171033 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Attempting to bind port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:24.171410 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Attempting to bind port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:24.171793 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Attempting to bind port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 on network 9c4884cd-a197-48ab-a497-3c07afe55035 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:24.187828 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:24.188394 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Checking segment: {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:24.189051 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:24.189548 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Bound using segment: {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:24.190149 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Bound port: b29eaf10-987b-4e3f-96b8-bb2cc38ba477, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:24.190569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:24.341883 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:24.383369 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:24.385899 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] For port b29eaf10-987b-4e3f-96b8-bb2cc38ba477, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:24.389899 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] For port b29eaf10-987b-4e3f-96b8-bb2cc38ba477, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:24.392150 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:24.397244 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:24.407394 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:24.486138 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Pushing event updated for resources: {'Port': ['ID=02de7cb4-1bc7-4e00-884a-b24a3093df70,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:24.491742 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:24.493268 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:24.494876 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:24.497632 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:24.596836 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Pushing event updated for resources: {'Port': ['ID=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:24.614273 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:25.070328 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:25.447946 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:25.717480 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Router e82a2c25-7086-45e3-b880-9d510f38463a is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91645) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:28:25.746504 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b29eaf10-987b-4e3f-96b8-bb2cc38ba477 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:25.803221 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-737d897c-8dad-48c0-8cc9-45bb4b7839fc None None] Network 9c4884cd-a197-48ab-a497-3c07afe55035 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:25.961666 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-fc688b4d-e25f-40c8-953c-8c1770ec00ea None None] Provisioning for port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:25.973779 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:25.975875 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:25.981817 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-fc688b4d-e25f-40c8-953c-8c1770ec00ea None None] Provisioning complete for port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:25.982197 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-fc688b4d-e25f-40c8-953c-8c1770ec00ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:25.984560 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Sync routers for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:26.005898 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:26.006560 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:26.038395 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:26.043375 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 3.1462920 May 20 20:28:26.044699 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 37958) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:26.069524 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:26.070592 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:26.200663 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-be6ed58a-fc44-4218-a9f4-f4f5093151df tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:26.240627 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-be6ed58a-fc44-4218-a9f4-f4f5093151df tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 0.2489684 May 20 20:28:26.271440 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-f8f8de93-2f52-4140-831b-70a2d82fb359 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/quotas/6eec95c790c84cfc8a6a2fbd90bb926c HTTP/1.1" status: 200 len: 375 time: 0.0297709 May 20 20:28:26.360418 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:26.382700 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-1d9934f7-7bfd-4916-bf83-2ff71e930501 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1103649 May 20 20:28:26.471357 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:26.538901 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port b29eaf10-987b-4e3f-96b8-bb2cc38ba477, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:26.545784 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-fc688b4d-e25f-40c8-953c-8c1770ec00ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:26.580136 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:26.587263 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:26.649614 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-931e8156-942b-4547-90a0-0c195e0e0ff6 service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2601440 May 20 20:28:26.883059 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:24Z', 'revision_number': 3, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:26.884011 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.db.api [None req-fc688b4d-e25f-40c8-953c-8c1770ec00ea None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=91647) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 20 20:28:26.884488 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_db.api [None req-fc688b4d-e25f-40c8-953c-8c1770ec00ea None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 20 20:28:26.889562 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Checking router: e82a2c25-7086-45e3-b880-9d510f38463a for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:26.890209 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Updating router e82a2c25-7086-45e3-b880-9d510f38463a port 02de7cb4-1bc7-4e00-884a-b24a3093df70 binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:28:26.898106 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:26.912168 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:26.970021 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-b07c30cc-47a2-4f10-bf0e-f47d83e78a36 service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3168523 May 20 20:28:26.972154 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:26.989406 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 37978) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:27.120410 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Deleting subnet 3305c376-fda9-4e41-a3fd-02e199629c67 {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:28:27.124322 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.192692 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.211057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.428799 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-05f5912a-82eb-436b-85b7-358e9fa5e5c2 req-d522b63b-0ba2-4c55-b491-e0b2ca8841b7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 210 time: 0.0999513 May 20 20:28:27.612080 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.625458 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-826e8201-4886-4ee1-81ff-016355a9121b None None] Provisioning complete for port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:27.627370 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-826e8201-4886-4ee1-81ff-016355a9121b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.692415 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b29eaf10-987b-4e3f-96b8-bb2cc38ba477 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:27.710607 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.738655 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Transition to ACTIVE for port object 02de7cb4-1bc7-4e00-884a-b24a3093df70 will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:27.755720 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.761082 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:27.881908 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Attempting to bind port 02de7cb4-1bc7-4e00-884a-b24a3093df70 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:27.882371 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Attempting to bind port 02de7cb4-1bc7-4e00-884a-b24a3093df70 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:27.882774 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Attempting to bind port 02de7cb4-1bc7-4e00-884a-b24a3093df70 on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:27.894965 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:27.895349 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:27.895752 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.896176 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:27.896660 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Bound port: 02de7cb4-1bc7-4e00-884a-b24a3093df70, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:27.897026 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.917643 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.933234 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:27.991297 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3305c376-fda9-4e41-a3fd-02e199629c67,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:27.993846 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:27.997428 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:28.005930 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ddc8eb38-cbc5-4788-bf68-83bb8066cf4b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3305c376-fda9-4e41-a3fd-02e199629c67 HTTP/1.1" status: 204 len: 168 time: 1.0124595 May 20 20:28:28.006784 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38012) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:28.036166 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:28.036708 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.045364 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] For port 02de7cb4-1bc7-4e00-884a-b24a3093df70, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:28.049065 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] For port 02de7cb4-1bc7-4e00-884a-b24a3093df70, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=02de7cb4-1bc7-4e00-884a-b24a3093df70,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:28.060498 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Pushing event updated for resources: {'Port': ['ID=02de7cb4-1bc7-4e00-884a-b24a3093df70,revision_number=2']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:28.064808 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.069665 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Allocated IP 172.20.0.1 (9c4884cd-a197-48ab-a497-3c07afe55035/845e6d5e-4ee4-43a5-a910-0fd3f1657178/a0794e95-f731-4932-8b25-f1ff4aaa7426) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:28.076714 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.077522 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.078019 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.078510 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.079065 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.079563 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.080120 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.080602 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.081230 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.082641 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.083162 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.083650 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:28:28.090784 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:28.094332 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.018s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:28.164826 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38016) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:28.172344 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Pushing event updated for resources: {'Port': ['ID=02de7cb4-1bc7-4e00-884a-b24a3093df70,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:28.189954 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.203314 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:28.203984 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:28.252792 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:28.349483 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.393704 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Transition to ACTIVE for port object a0794e95-f731-4932-8b25-f1ff4aaa7426 will not be triggered until provisioned by entity DHCP. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:28.419280 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.431115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.446395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > segment before_delete 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.446752 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.447481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.447835 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > port after_create 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.448175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > port after_delete 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.448521 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > port after_update 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.449106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > segment after_delete 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.449226 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:28.449435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.449751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.450131 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet after_update 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.460791 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.475190 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:28.522206 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Network 9c4884cd-a197-48ab-a497-3c07afe55035 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:28.528518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:28.549252 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:28.549867 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.623044 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Pushing event updated for resources: {'Port': ['ID=a0794e95-f731-4932-8b25-f1ff4aaa7426,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:28.634049 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.638647 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:28.639806 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.639806 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet before_create 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.640028 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Subscribe: > subnet before_update 55550000 {{(pid=91646) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:28:28.644595 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ba53435e-5386-4ba1-ad63-6c40a6baa7a1']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:28.779571 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9fa7a75a-96c2-47f7-ab0c-41b383012256') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:28.780011 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9fa7a75a-96c2-47f7-ab0c-41b383012256') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:28.792417 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:28.799124 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5dfc060b-b440-44ba-9c56-ce83fac0e8f7 req-5fec36ee-7dc0-4f88-90c4-f4183c931bcc tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 210 time: 0.1313510 May 20 20:28:28.804426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.811604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Usage tracker for resource:security_group_rule and tenant:510228e9c32f4eefbe639b3ebfd9afcb is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:28.831216 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:28.841578 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:28.849114 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.860850 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.864976 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Releasing vlan 812 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:28:28.865494 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: from cryptography.utils import int_from_bytes May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: from cryptography.utils import int_from_bytes May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:28:28.882704 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:28:28.961863 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-6c06fd84-cde5-4f1c-bb19-5aa8c709fe1f None None] Provisioning for port a0794e95-f731-4932-8b25-f1ff4aaa7426 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:28.971691 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-6c06fd84-cde5-4f1c-bb19-5aa8c709fe1f None None] Provisioning complete for port a0794e95-f731-4932-8b25-f1ff4aaa7426 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:28.975583 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6c06fd84-cde5-4f1c-bb19-5aa8c709fe1f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:28.994315 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.005171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:29.021773 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:24Z', 'revision_number': 3, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:29.034213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.038809 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-154a6402-2760-401e-86b7-e41f31699e43 None None] The sync data for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi is: [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:24Z', 'revision_number': 3, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:29.053589 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-6c06fd84-cde5-4f1c-bb19-5aa8c709fe1f None None] Port a0794e95-f731-4932-8b25-f1ff4aaa7426 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:28:29.055239 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Pushing event deleted for resources: {'Network': ['ID=ba53435e-5386-4ba1-ad63-6c40a6baa7a1,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:29.067554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:29.088758 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] 10.222.0.82 "DELETE /v2.0/networks/ba53435e-5386-4ba1-ad63-6c40a6baa7a1 HTTP/1.1" status: 204 len: 168 time: 1.0775809 May 20 20:28:29.096115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.105114 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.129747 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-809d7ec1-874b-4fed-82fe-a63d151a05de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.009s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:29.210275 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=768849dd-63aa-45f1-97a1-1a1ecdb9fe30,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:29.234892 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:29.236748 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.244761 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=510228e9c32f4eefbe639b3ebfd9afcb&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0786512 May 20 20:28:29.245738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38040) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:29.254780 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.258834 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.269762 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b43f9e92-390b-4ecb-af82-883376a218ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:29.329146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.354822 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38044) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:29.390251 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.488518 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-1b098d88-5868-4e66-9232-fcc3c997c02b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=86c5233ea65940628ae25f1515bce737&name=default HTTP/1.1" status: 200 len: 2975 time: 0.1318903 May 20 20:28:29.492326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38048) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:29.570100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.591055 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dfa63543-f28a-4229-b949-32621a30b5dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:29.625086 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=768849dd-63aa-45f1-97a1-1a1ecdb9fe30,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:29.630161 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:29.630946 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.650171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.665101 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/768849dd-63aa-45f1-97a1-1a1ecdb9fe30 HTTP/1.1" status: 204 len: 168 time: 0.4181237 May 20 20:28:29.708796 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.807108 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.810177 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 02de7cb4-1bc7-4e00-884a-b24a3093df70 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:29.823975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fdc07261-6c09-4323-b5da-f6917e66ed14 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:29.893433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=986983b6-1bd7-49d6-9a19-3836f95202fa,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:29.922451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:29.958678 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:29.964971 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/986983b6-1bd7-49d6-9a19-3836f95202fa HTTP/1.1" status: 204 len: 168 time: 0.4714544 May 20 20:28:30.268816 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 02de7cb4-1bc7-4e00-884a-b24a3093df70 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:30.285968 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 02de7cb4-1bc7-4e00-884a-b24a3093df70 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:30.292004 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:30.499286 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Network 9c4884cd-a197-48ab-a497-3c07afe55035 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:30.510172 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:30.539055 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0ab19832-5700-45af-8270-fc6a0eea200a req-4f1c74c3-cf7d-40d1-a195-aa03f643a8ba tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 210 time: 0.2138629 May 20 20:28:30.632551 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38082) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:30.641348 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Pushing event updated for resources: {'Port': ['ID=a0794e95-f731-4932-8b25-f1ff4aaa7426,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:30.648591 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.381s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:30.650911 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:30.672854 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:30.692205 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 02de7cb4-1bc7-4e00-884a-b24a3093df70, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=02de7cb4-1bc7-4e00-884a-b24a3093df70,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:30.704538 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:30.707112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:30.712505 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:30.725255 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Usage tracker for resource:security_group_rule and tenant:cc204f590ad74f13b50b5aac68a8dd46 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:30.732548 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:30.742673 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-4ed55cd3-f829-4210-886e-2b2d1f7f1ed2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:30.743473 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-4ed55cd3-f829-4210-886e-2b2d1f7f1ed2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:network {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:30.746786 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:30.861325 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=02de7cb4-1bc7-4e00-884a-b24a3093df70,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:30.876706 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:30.886542 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:30.892062 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-4ed55cd3-f829-4210-886e-2b2d1f7f1ed2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:network {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:30.893360 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-4ed55cd3-f829-4210-886e-2b2d1f7f1ed2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 1.3237853 May 20 20:28:30.896082 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:30.914831 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-355ac38b-c222-468c-98b8-2d76693c88fc None None] Provisioning complete for port a0794e95-f731-4932-8b25-f1ff4aaa7426 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:30.915263 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-355ac38b-c222-468c-98b8-2d76693c88fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:30.919122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:30.940419 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Router e82a2c25-7086-45e3-b880-9d510f38463a has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:28:30.961450 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=cc204f590ad74f13b50b5aac68a8dd46&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3278022 May 20 20:28:30.964066 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38094) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:30.996077 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-355ac38b-c222-468c-98b8-2d76693c88fc None None] Port a0794e95-f731-4932-8b25-f1ff4aaa7426 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:28:31.012252 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=211d4f64-0a6e-455b-8d7d-d1f597d300d9,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:31.015274 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:31.064323 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:31.094017 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:31.151808 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:31.158918 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:31.163898 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] 10.222.0.82 "PUT /v2.0/routers/e82a2c25-7086-45e3-b880-9d510f38463a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1157105 May 20 20:28:31.164175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:31.176202 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=211d4f64-0a6e-455b-8d7d-d1f597d300d9,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:31.178529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:31.185112 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:31.186294 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/211d4f64-0a6e-455b-8d7d-d1f597d300d9 HTTP/1.1" status: 204 len: 168 time: 0.2211728 May 20 20:28:31.606828 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Sync routers for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:31.637022 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:31.637661 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:31.699743 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 02de7cb4-1bc7-4e00-884a-b24a3093df70 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:31.810796 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38136) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:31.890404 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:31.932421 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 02de7cb4-1bc7-4e00-884a-b24a3093df70 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:31.932796 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.066514 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38150) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:32.072903 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1893654432-network', 'tenant_id': '274035bf70724af18a11e7a6e457ed03'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:32.079252 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:32.084971 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Usage tracker for resource:network and tenant:274035bf70724af18a11e7a6e457ed03 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:32.088893 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:32.098022 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:32.111942 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Made reservation on behalf of 274035bf70724af18a11e7a6e457ed03 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:32.116636 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.134437 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.158525 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-880066623-network', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:32.164851 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:32.168015 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:32.172834 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Usage tracker for resource:security_group_rule and tenant:274035bf70724af18a11e7a6e457ed03 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:32.175821 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Usage tracker for resource:network and tenant:d7d330ce02bc4a5b849c6cd53ef67558 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:32.178901 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:32.182060 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:32.189402 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:32.191754 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:32.220822 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Made reservation on behalf of d7d330ce02bc4a5b849c6cd53ef67558 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:32.224806 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.249280 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.275216 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:32.288199 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Usage tracker for resource:security_group_rule and tenant:d7d330ce02bc4a5b849c6cd53ef67558 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:32.289802 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:32.303455 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:32.365979 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 2, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:32.367958 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.371084 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Checking router: e82a2c25-7086-45e3-b880-9d510f38463a for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:32.371516 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Updating router e82a2c25-7086-45e3-b880-9d510f38463a port a0794e95-f731-4932-8b25-f1ff4aaa7426 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:28:32.375627 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.381062 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c0316af5-3a7a-498b-bfae-b93fda70c8a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:32.417678 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] vlan segment allocate from pool success with {'vlan_id': 805, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:28:32.433718 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4d83034-90d9-4869-aa4c-b04fefeb3d0b,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:32.436424 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.442503 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:32.448964 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.449301 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Added segment f44e922f-ca7d-4170-be3d-efa9bae9e44e of type vlan for network 41de6d5d-bea0-49fe-8865-f88749093770 May 20 20:28:32.499250 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.501384 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.506811 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.512780 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:32.556791 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] vlan segment allocate from pool success with {'vlan_id': 833, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:28:32.571782 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:32.575572 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:32.578394 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.579446 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.579795 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Added segment a7f5843a-4d24-4474-8e1a-3683e9d0f8a4 of type vlan for network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 May 20 20:28:32.581938 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:32.582518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.591102 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a08f4daf-3725-4a96-aaa2-07bec6a70c4e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:32.664065 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.734108 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Pushing event updated for resources: {'Network': ['ID=41de6d5d-bea0-49fe-8865-f88749093770,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:32.744266 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:32.756810 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6889825 May 20 20:28:32.759567 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38170) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:32.768358 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Request body: {'subnet': {'network_id': '41de6d5d-bea0-49fe-8865-f88749093770', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1893654432-subnet', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:32.773010 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.775943 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:32.776933 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.778359 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:32.784043 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:32.792493 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Usage tracker for resource:subnet and tenant:274035bf70724af18a11e7a6e457ed03 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:32.796683 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:32.813721 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:32.823724 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 41de6d5d-bea0-49fe-8865-f88749093770 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:28:32.835947 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Made reservation on behalf of 274035bf70724af18a11e7a6e457ed03 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:32.839465 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3870000'] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.850830 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.0374465 May 20 20:28:32.859182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38174) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:32.871356 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Request body: {'subnet': {'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-subnet', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:32.871538 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:32.901469 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:32.911433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Usage tracker for resource:subnet and tenant:d7d330ce02bc4a5b849c6cd53ef67558 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:32.914131 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Pushing event updated for resources: {'Network': ['ID=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:32.916855 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:32.917206 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:32.942401 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:28:32.977006 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:32.999624 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Transition to ACTIVE for port object a0794e95-f731-4932-8b25-f1ff4aaa7426 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:33.003905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Made reservation on behalf of d7d330ce02bc4a5b849c6cd53ef67558 for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:33.006400 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3870000'] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:33.060724 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:33.070278 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c4a5cf6d-0cc8-46ce-bd47-81871bffe992 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:33.287174 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ba4827-1ef1-450a-ba41-b844d850e110 None None] Pushing event updated for resources: {'Port': ['ID=a0794e95-f731-4932-8b25-f1ff4aaa7426,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:33.338370 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-a7ba4827-1ef1-450a-ba41-b844d850e110 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:33.368479 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Attempting to bind port a0794e95-f731-4932-8b25-f1ff4aaa7426 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:33.368976 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Attempting to bind port a0794e95-f731-4932-8b25-f1ff4aaa7426 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:33.369773 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Attempting to bind port a0794e95-f731-4932-8b25-f1ff4aaa7426 on network 9c4884cd-a197-48ab-a497-3c07afe55035 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:33.375962 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:33.376630 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Checking segment: {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:33.377289 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:33.377668 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Bound using segment: {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:33.378875 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Bound port: a0794e95-f731-4932-8b25-f1ff4aaa7426, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:33.379376 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:33.489107 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] For port a0794e95-f731-4932-8b25-f1ff4aaa7426, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:33.492594 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] For port a0794e95-f731-4932-8b25-f1ff4aaa7426, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=a0794e95-f731-4932-8b25-f1ff4aaa7426,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:33.497996 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:33.502205 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:33.615843 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:33.616488 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:33.686980 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ba4827-1ef1-450a-ba41-b844d850e110 None None] Pushing event updated for resources: {'Port': ['ID=a0794e95-f731-4932-8b25-f1ff4aaa7426,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:33.705390 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-a7ba4827-1ef1-450a-ba41-b844d850e110 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:33.751713 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2785475', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3869986'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:33.763176 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-48903534-9ec3-4dbf-ad4f-b16b6d645774 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:33.860411 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:33.892957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a224f1d0-85ff-4e37-8956-31561c5c3c98,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:33.898601 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2785475', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3869986'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:33.899567 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:33.908079 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:33.962283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Checking segment: {'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:33.962637 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Network hostable DHCP agents. Network: 41de6d5d-bea0-49fe-8865-f88749093770, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:28:34.027376 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Pushing event updated for resources: {'Subnet': ['ID=2ad34b95-1b62-4f29-a7ba-63bf116ecc64,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:34.033226 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:34.033971 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Checking segment: {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:34.034871 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Network hostable DHCP agents. Network: 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:28:34.045521 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Network 41de6d5d-bea0-49fe-8865-f88749093770 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:28:34.059720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 41de6d5d-bea0-49fe-8865-f88749093770) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:34.071076 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:34.072339 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.077680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:28:34.078609 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f698b04f-951b-459b-a226-cc19173fb520 None None] Network 41de6d5d-bea0-49fe-8865-f88749093770 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:34.091714 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:34.105340 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:34.105933 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.115520 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.3515711 May 20 20:28:34.115889 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38214) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:34.121426 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:34.125724 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bec1f7e-7fec-47f9-bcba-24adfe95af08 None None] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:34.129151 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:34.132300 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-aeb2a04b-f390-420b-bbdb-fdb3c7e57f6a admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.2719076 May 20 20:28:34.134613 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38218) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:34.136654 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Usage tracker for resource:router and tenant:274035bf70724af18a11e7a6e457ed03 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:34.140028 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:34.140757 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:34.145879 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:34.146536 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:34.150775 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Usage tracker for resource:router and tenant:d7d330ce02bc4a5b849c6cd53ef67558 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:34.153939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:34.160876 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:34.161200 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.162248 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.179234 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.181134 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.196658 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.235148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.336667 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38226) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:34.551385 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.601527 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.688087 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:34.692940 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.699100 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dcb99ec-36a4-411e-8734-869199e50cd7 None None] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:34.699402 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Usage tracker for resource:security_group_rule and tenant:17bfee1d0aee4ee5a64bd6ed8c3edea1 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:34.702994 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:34.710449 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:34.712463 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:33Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:34.750828 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0940bb0f-0c79-42eb-a2cd-58805aea6e99 None None] The sync data for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi is: [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:33Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:34.809781 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-41de6d5d-bea0-49fe-8865-f88749093770', 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'fixed_ips': [{'subnet_id': 'a224f1d0-85ff-4e37-8956-31561c5c3c98'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:28:34.809781 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.834225 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-65b371f5-200f-4cec-8690-8d5867ad13ba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:34.895743 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Request body: {'port': {'device_id': '94b16202-270d-4a17-8756-b78db90d62eb', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'admin_state_up': True, 'tenant_id': '6eec95c790c84cfc8a6a2fbd90bb926c'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:35.017144 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.062666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.168553 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Allocated IP 172.20.0.2 (41de6d5d-bea0-49fe-8865-f88749093770/a224f1d0-85ff-4e37-8956-31561c5c3c98/9ffa3540-d25e-42e9-8392-353cbd248b97) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:35.199203 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.209362 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.220209 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9ef331da-a51c-4603-b53a-4a34867cd595 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:35.244056 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:35.251107 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-65996ee3-de2d-496c-8c33-c5c4414e6ecf req-d3c232f8-ad72-4851-9ea1-a9a4c6b06554 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 210 time: 0.0733933 May 20 20:28:35.290006 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:35.344384 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Allocated IP 172.27.3.75 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/1e1ad36c-3452-4567-9c16-3d7790968cda) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:35.349142 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=17bfee1d0aee4ee5a64bd6ed8c3edea1&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0113797 May 20 20:28:35.349987 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38236) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:35.381940 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e2f182d-250b-4a96-8f28-16c7f23ef4fb,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:35.385254 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:35.455557 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Made reservation on behalf of 6eec95c790c84cfc8a6a2fbd90bb926c for: {'port': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:35.459972 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.564978 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.579860 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.593631 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Transition to ACTIVE for port object 9ffa3540-d25e-42e9-8392-353cbd248b97 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:35.613274 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.632515 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Transition to ACTIVE for port object 9ffa3540-d25e-42e9-8392-353cbd248b97 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:35.640854 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.646184 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:35.733580 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device a0794e95-f731-4932-8b25-f1ff4aaa7426 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:35.741847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.759394 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.784497 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.794027 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Network 41de6d5d-bea0-49fe-8865-f88749093770 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:35.801094 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:35.804770 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:35.815288 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:35.865881 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:35.891430 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Pushing event updated for resources: {'Port': ['ID=1e1ad36c-3452-4567-9c16-3d7790968cda,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:35.902604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:35.904554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:35.906066 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:35.908530 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:35.925301 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Pushing event updated for resources: {'Port': ['ID=9ffa3540-d25e-42e9-8392-353cbd248b97,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:35.961517 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:35.997934 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Attempting to bind port 9ffa3540-d25e-42e9-8392-353cbd248b97 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:35.998309 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Attempting to bind port 9ffa3540-d25e-42e9-8392-353cbd248b97 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:35.998800 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Attempting to bind port 9ffa3540-d25e-42e9-8392-353cbd248b97 on network 41de6d5d-bea0-49fe-8865-f88749093770 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:36.012473 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:36.012851 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Checking segment: {'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:36.013254 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.013648 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Bound using segment: {'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:36.014121 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Bound port: 9ffa3540-d25e-42e9-8392-353cbd248b97, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:36.014496 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.055854 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Allocated IP 172.27.3.250 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/1d502ad2-ac9d-401d-ac74-575c2dae4457) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:36.066517 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port a0794e95-f731-4932-8b25-f1ff4aaa7426 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:36.094679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port a0794e95-f731-4932-8b25-f1ff4aaa7426 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:36.095079 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.107221 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Allocated IP 172.20.0.9 (2021d324-55d7-4959-b1a9-ee3e58b34538/8debe367-8908-48d3-a2e2-6afb3c3cda2a/08f701b8-1580-4323-b2f2-c088e14e4e28) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:36.166088 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.221940 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] For port 9ffa3540-d25e-42e9-8392-353cbd248b97, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:36.227319 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a5558f65-ea2e-48b0-b1bb-d92b4272e878 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:36.243654 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] For port 9ffa3540-d25e-42e9-8392-353cbd248b97, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=9ffa3540-d25e-42e9-8392-353cbd248b97,segment=NetworkSegment(f44e922f-ca7d-4170-be3d-efa9bae9e44e),segment_id=f44e922f-ca7d-4170-be3d-efa9bae9e44e)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:36.254268 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.268198 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:36.272114 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e2f182d-250b-4a96-8f28-16c7f23ef4fb,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:36.293066 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:36.472905 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.489457 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.491876 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2e2f182d-250b-4a96-8f28-16c7f23ef4fb HTTP/1.1" status: 204 len: 168 time: 1.1319473 May 20 20:28:36.542748 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Pushing event updated for resources: {'Port': ['ID=9ffa3540-d25e-42e9-8392-353cbd248b97,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:36.552997 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:36.566338 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.572352 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-b4b5cfd7-c740-44ca-bbc3-3dada31f0b4f req-c62d2b5d-43a1-4ae4-ae2f-02bdc4b66cdf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:36.645122 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-b4b5cfd7-c740-44ca-bbc3-3dada31f0b4f req-c62d2b5d-43a1-4ae4-ae2f-02bdc4b66cdf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:36.646304 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b4b5cfd7-c740-44ca-bbc3-3dada31f0b4f req-c62d2b5d-43a1-4ae4-ae2f-02bdc4b66cdf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 210 time: 0.1453269 May 20 20:28:36.649445 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port a0794e95-f731-4932-8b25-f1ff4aaa7426, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=a0794e95-f731-4932-8b25-f1ff4aaa7426,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:36.653981 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.664520 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.667695 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:36.705525 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:36.715218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:36.824673 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=a0794e95-f731-4932-8b25-f1ff4aaa7426,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:36.828188 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:36.854126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.071013 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.079187 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:37.088288 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:37.092309 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:37.092505 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:28:37.119481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38270) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:37.228663 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.351206 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.374180 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:37.382705 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Usage tracker for resource:security_group_rule and tenant:a678de1361b941b9bc4bdb204edbe558 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:37.385697 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.388546 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:37.445484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:37.453857 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Pushing event updated for resources: {'Port': ['ID=1d502ad2-ac9d-401d-ac74-575c2dae4457,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:37.456778 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.742s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:37.460620 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0fcfa598-e686-4ed0-8a52-fbcae3e9d5cd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.091s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:37.495096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c38da861-f763-487e-9184-3b73dd091ee3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.521759 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:37.531310 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:37.533745 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:37.539995 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:37.540604 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.637104 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event updated for resources: {'Port': ['ID=08f701b8-1580-4323-b2f2-c088e14e4e28,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:37.641104 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:37.651858 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.7616706 May 20 20:28:37.674121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Request body: {'port': {'device_id': '94b16202-270d-4a17-8756-b78db90d62eb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:37.690066 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91646) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:28:37.698425 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.761721 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.764893 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:37.780434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-53482349-c6d3-4367-8a0e-7d6c3ead29d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:37.851618 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a678de1361b941b9bc4bdb204edbe558&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7308757 May 20 20:28:37.855484 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38284) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:37.869993 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device a0794e95-f731-4932-8b25-f1ff4aaa7426 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:37.956557 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-936e1736-c40b-453f-8eef-1757797e75f7 None None] Network 41de6d5d-bea0-49fe-8865-f88749093770 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:38.029381 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.048453 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38215807-be0b-4588-afcf-aa9e506e9e28,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:38.069764 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:38.109422 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port a0794e95-f731-4932-8b25-f1ff4aaa7426 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:38.109635 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.138733 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-9beb657c-47b8-49a0-b8e3-8718629802d6 None None] Provisioning for port 9ffa3540-d25e-42e9-8392-353cbd248b97 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:38.148278 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:38.154841 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.168259 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.170269 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Sync routers for ids ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:38.182446 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Routers {'d41c5f32-65d4-42ea-8e08-4ee398ba1a44'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:38.182810 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:38.197590 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.202114 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 4.0655539 May 20 20:28:38.211559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b9853e6-ee6a-41cc-b868-ed63256dc78d req-c325b59a-1a2f-42ad-979d-03a6974face1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:38.213465 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b9853e6-ee6a-41cc-b868-ed63256dc78d req-c325b59a-1a2f-42ad-979d-03a6974face1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 931 time: 0.1543014 May 20 20:28:38.213990 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38290) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:38.276638 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.394231 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 9ffa3540-d25e-42e9-8392-353cbd248b97 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:38.506085 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 9ffa3540-d25e-42e9-8392-353cbd248b97 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:38.513738 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 9ffa3540-d25e-42e9-8392-353cbd248b97 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:38.520457 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.599548 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Set router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:38.680152 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.704989 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4a5ee949-6e3e-4fcb-8354-6fbd2fe7a3ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:38.764406 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.788194 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38215807-be0b-4588-afcf-aa9e506e9e28,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:38.790970 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.808386 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:38.823955 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 9ffa3540-d25e-42e9-8392-353cbd248b97, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=9ffa3540-d25e-42e9-8392-353cbd248b97,segment=NetworkSegment(f44e922f-ca7d-4170-be3d-efa9bae9e44e),segment_id=f44e922f-ca7d-4170-be3d-efa9bae9e44e)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:38.839904 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.855442 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:38.938543 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b9853e6-ee6a-41cc-b868-ed63256dc78d req-ca0846e4-8f2c-4f4e-8be4-d85f79edcdbf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3401268 May 20 20:28:38.954101 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-fdabc6dc-41f3-47c2-9173-df326e2171e1 None None] Provisioning complete for port 9ffa3540-d25e-42e9-8392-353cbd248b97 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:38.954324 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.954553 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-fdabc6dc-41f3-47c2-9173-df326e2171e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:38.959554 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/38215807-be0b-4588-afcf-aa9e506e9e28 HTTP/1.1" status: 204 len: 168 time: 1.0764692 May 20 20:28:39.093804 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=9ffa3540-d25e-42e9-8392-353cbd248b97,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:39.106505 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:39.156314 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 3, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port': {'id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:39.170691 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Checking router: d41c5f32-65d4-42ea-8e08-4ee398ba1a44 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:39.171958 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Updating router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 port 1e1ad36c-3452-4567-9c16-3d7790968cda binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:28:39.266617 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.422597 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91645) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:28:39.434685 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 08f701b8-1580-4323-b2f2-c088e14e4e28 {{(pid=91645) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:28:39.446444 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.457614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.545123 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Transition to ACTIVE for port object 08f701b8-1580-4323-b2f2-c088e14e4e28 will not be triggered until provisioned by entity L2. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:39.555863 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.564255 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:39.673335 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 9ffa3540-d25e-42e9-8392-353cbd248b97 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:39.764775 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 9ffa3540-d25e-42e9-8392-353cbd248b97 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:39.765630 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.797626 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:28:39.817790 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.841256 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Pushing event updated for resources: {'Port': ['ID=08f701b8-1580-4323-b2f2-c088e14e4e28,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:39.842058 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Allocated IP 172.20.0.1 (4ab99f46-8cd1-404d-95ae-c95a8ddd9d72/2ad34b95-1b62-4f29-a7ba-63bf116ecc64/c0fdfd3a-cf39-40ab-842f-b7613dba71a5) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:39.851396 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Transition to ACTIVE for port object 1e1ad36c-3452-4567-9c16-3d7790968cda will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:39.860333 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.863155 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:39.869438 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:39.869880 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:39.895255 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Attempting to bind port 08f701b8-1580-4323-b2f2-c088e14e4e28 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:39.895605 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Attempting to bind port 08f701b8-1580-4323-b2f2-c088e14e4e28 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:39.895945 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Attempting to bind port 08f701b8-1580-4323-b2f2-c088e14e4e28 on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:39.904275 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Sync routers for ids ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:39.908528 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Port 08f701b8-1580-4323-b2f2-c088e14e4e28 on network 2021d324-55d7-4959-b1a9-ee3e58b34538 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:28:39.908853 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Attempting to bind port 08f701b8-1580-4323-b2f2-c088e14e4e28 on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:39.917797 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:39.918204 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Checking segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:39.918564 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Bound using segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:39.919388 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Bound port: 08f701b8-1580-4323-b2f2-c088e14e4e28, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:39.919806 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.937173 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:39.938726 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 5.8215241 May 20 20:28:39.942148 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38334) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:39.947712 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.005749 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Routers {'9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:40.006650 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:40.072547 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Attempting to bind port 1e1ad36c-3452-4567-9c16-3d7790968cda on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:40.073343 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Attempting to bind port 1e1ad36c-3452-4567-9c16-3d7790968cda by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:40.073498 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Attempting to bind port 1e1ad36c-3452-4567-9c16-3d7790968cda on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:40.101139 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cccc8d8-7b9e-420c-8ae4-dbebdfeab671 None None] Pushing event updated for resources: {'Port': ['ID=1e1ad36c-3452-4567-9c16-3d7790968cda,revision_number=2']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:40.117672 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:40.118316 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:40.118864 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.119373 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:40.120222 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Bound port: 1e1ad36c-3452-4567-9c16-3d7790968cda, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:40.120745 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.217770 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.258142 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] For port 1e1ad36c-3452-4567-9c16-3d7790968cda, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:40.262110 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] For port 1e1ad36c-3452-4567-9c16-3d7790968cda, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=1e1ad36c-3452-4567-9c16-3d7790968cda,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:40.264326 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-4cccc8d8-7b9e-420c-8ae4-dbebdfeab671 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:40.271477 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.280154 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:40.320540 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.325195 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:40.408146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:40.413070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:40.423053 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:40.442676 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Set router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:40.485024 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Pushing event updated for resources: {'Port': ['ID=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:40.496576 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:40.510912 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.525924 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cccc8d8-7b9e-420c-8ae4-dbebdfeab671 None None] Pushing event updated for resources: {'Port': ['ID=1e1ad36c-3452-4567-9c16-3d7790968cda,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:40.529759 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-4cccc8d8-7b9e-420c-8ae4-dbebdfeab671 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:40.566473 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Routers {'d41c5f32-65d4-42ea-8e08-4ee398ba1a44'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:40.567186 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:40.725320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:40.866162 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] Set router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:40.941560 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250'}], 'enable_snat': True}, 'gw_port_id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:37Z', 'revision_number': 3, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port': {'id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:9e:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:40.959988 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Checking router: 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:40.960345 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Updating router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 port 1d502ad2-ac9d-401d-ac74-575c2dae4457 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:28:41.066449 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] For port 08f701b8-1580-4323-b2f2-c088e14e4e28, host hv-cinder-78462, cleared binding levels {{(pid=91645) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:41.132747 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.228416 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.319183 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.322726 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38376) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:41.340613 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.418392 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:41.462451 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] For port 08f701b8-1580-4323-b2f2-c088e14e4e28, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=08f701b8-1580-4323-b2f2-c088e14e4e28,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91645) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:41.483401 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.527040 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:41.555097 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Pushing event updated for resources: {'Port': ['ID=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:41.558119 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:41.559090 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.596443 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:40Z', 'revision_number': 4, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port': {'id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'c0fdfd3a-cf39-40ab-842f-b7613dba71a5', 'name': '', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'mac_address': 'fa:16:3e:76:02:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_interface', 'standard_attr_id': 298, 'fixed_ips': [{'subnet_id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:39Z', 'updated_at': '2021-05-20T20:28:39Z', 'revision_number': 1, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'subnets': [{'id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:41.605065 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e0a19c3-4a21-41b2-be8c-c8950b712f1e None None] The sync data for ids ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'] in dv-cinder-784623-13-iscsi is: [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:40Z', 'revision_number': 4, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port': {'id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'c0fdfd3a-cf39-40ab-842f-b7613dba71a5', 'name': '', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'mac_address': 'fa:16:3e:76:02:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_interface', 'standard_attr_id': 298, 'fixed_ips': [{'subnet_id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:39Z', 'updated_at': '2021-05-20T20:28:39Z', 'revision_number': 1, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'subnets': [{'id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:41.606527 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.658298 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:41.671817 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Pushing event updated for resources: {'Port': ['ID=08f701b8-1580-4323-b2f2-c088e14e4e28,revision_number=3']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:41.673308 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:41.738869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a293ffba-8fe4-4713-9936-36acee82aa14 req-8498c6f6-5603-4fc9-b83a-848b9ba4f261 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:41.740970 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.748231 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a293ffba-8fe4-4713-9936-36acee82aa14 req-8498c6f6-5603-4fc9-b83a-848b9ba4f261 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 943 time: 1.2846324 May 20 20:28:41.757078 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Transition to ACTIVE for port object 1d502ad2-ac9d-401d-ac74-575c2dae4457 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:41.768991 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.785895 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4b6864a7-1e0d-4838-a58f-1733111245b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:41.793909 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:41.794615 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.796134 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] 10.222.0.69 "PUT /v2.0/ports/08f701b8-1580-4323-b2f2-c088e14e4e28 HTTP/1.1" status: 200 len: 1093 time: 4.1272357 May 20 20:28:41.798744 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94b16202-270d-4a17-8756-b78db90d62eb', 'tag': '08f701b8-1580-4323-b2f2-c088e14e4e28'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:41.823081 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Usage tracker for resource:security_group_rule and tenant:e799838fef1b447596af46b142de3932 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:41.850723 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:41.865659 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a293ffba-8fe4-4713-9936-36acee82aa14 req-c0063b59-797a-4289-ab59-1f4c022a7ee5 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1161904 May 20 20:28:41.886908 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Attempting to bind port 1d502ad2-ac9d-401d-ac74-575c2dae4457 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:41.887313 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Attempting to bind port 1d502ad2-ac9d-401d-ac74-575c2dae4457 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:41.887680 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Attempting to bind port 1d502ad2-ac9d-401d-ac74-575c2dae4457 on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:41.889437 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:41.903836 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:41.905770 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:41.906240 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.906667 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:41.907155 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Bound port: 1d502ad2-ac9d-401d-ac74-575c2dae4457, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:41.907613 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:41.952711 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94b16202-270d-4a17-8756-b78db90d62eb', 'tag': '08f701b8-1580-4323-b2f2-c088e14e4e28', 'status': 'completed', 'code': 200} May 20 20:28:41.974359 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:41.978721 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:42.017734 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ac7095-3d8e-4b2a-ae36-bb904f3db3f5 None None] Pushing event updated for resources: {'Port': ['ID=1d502ad2-ac9d-401d-ac74-575c2dae4457,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:42.023153 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-e5ac7095-3d8e-4b2a-ae36-bb904f3db3f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:42.037260 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] For port 1d502ad2-ac9d-401d-ac74-575c2dae4457, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:42.042647 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] For port 1d502ad2-ac9d-401d-ac74-575c2dae4457, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=1d502ad2-ac9d-401d-ac74-575c2dae4457,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:42.049019 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.052967 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:42.120315 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-fcc6124d-d953-40cf-a864-a7581badf2ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:42.133960 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-fcc6124d-d953-40cf-a864-a7581badf2ef service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 1096 time: 0.2592149 May 20 20:28:42.138019 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.139722 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Routers {'9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:42.140438 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:42.257063 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.258577 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ac7095-3d8e-4b2a-ae36-bb904f3db3f5 None None] Pushing event updated for resources: {'Port': ['ID=1d502ad2-ac9d-401d-ac74-575c2dae4457,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:42.258993 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-9f8ed540-7900-4933-91c6-7f73b39f0257 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=08f701b8-1580-4323-b2f2-c088e14e4e28 HTTP/1.1" status: 200 len: 217 time: 0.0884244 May 20 20:28:42.270538 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-e5ac7095-3d8e-4b2a-ae36-bb904f3db3f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:42.275103 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.284873 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:28:42.285946 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0dda8502-03fc-4863-9b85-e90232f93c78 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:42.400845 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e799838fef1b447596af46b142de3932&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0722201 May 20 20:28:42.411597 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5091228c-d002-469f-af88-527aa79964db,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:42.416886 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38394) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:42.434833 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:42.462708 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] Set router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:42.476404 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-bebefa3e-e165-45f3-ad88-06544e53c158 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:42.477879 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-bebefa3e-e165-45f3-ad88-06544e53c158 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.1700842 May 20 20:28:42.560920 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:42.578574 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Allocated IP 172.20.0.1 (41de6d5d-bea0-49fe-8865-f88749093770/a224f1d0-85ff-4e37-8956-31561c5c3c98/97184dad-75cc-4d84-b739-0ac5a43dc683) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:42.623412 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] 10.222.0.82 "PUT /v2.0/routers/d41c5f32-65d4-42ea-8e08-4ee398ba1a44/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4078705 May 20 20:28:42.684825 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-8375f3f9-d8e5-4c43-9263-72b533fd0ddc service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0893333 May 20 20:28:42.687904 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.742309 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.878410 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.893794 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8ef6c5cd-1e60-4022-9d0c-be481afdefcd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:42.920592 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5091228c-d002-469f-af88-527aa79964db,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:42.937687 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:42.959664 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:42.966600 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5091228c-d002-469f-af88-527aa79964db HTTP/1.1" status: 204 len: 168 time: 0.5461605 May 20 20:28:42.996545 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:43.014141 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Transition to ACTIVE for port object 97184dad-75cc-4d84-b739-0ac5a43dc683 will not be triggered until provisioned by entity DHCP. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:43.017146 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250'}], 'enable_snat': True}, 'gw_port_id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:37Z', 'revision_number': 3, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port': {'id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:9e:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:43.029016 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d45ef91-007d-488f-b9b3-a149643609c7 None None] The sync data for ids ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'] in dv-cinder-784623-13-iscsi is: [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250'}], 'enable_snat': True}, 'gw_port_id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:37Z', 'revision_number': 3, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port': {'id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:9e:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:43.106499 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:43.125286 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:43.305600 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-b12168a2-38ae-4ec6-a15d-87337eb31249 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5892928 May 20 20:28:43.359273 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Network 41de6d5d-bea0-49fe-8865-f88749093770 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:43.390123 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:43.393545 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:43.394330 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:43.462270 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Pushing event updated for resources: {'Port': ['ID=97184dad-75cc-4d84-b739-0ac5a43dc683,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:43.476423 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:43.689813 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0588381e-2671-4531-b7f2-278dfd89e7be req-3468650e-81ae-4d9f-a496-55a56ac1ccc9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:43.698614 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0588381e-2671-4531-b7f2-278dfd89e7be req-3468650e-81ae-4d9f-a496-55a56ac1ccc9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 943 time: 0.6563032 May 20 20:28:43.699365 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38424) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:43.742846 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:43.811213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:43.825245 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Usage tracker for resource:security_group_rule and tenant:e47444402f4248d7be4ac884e38cbcdf is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:43.828919 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:43.841561 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:43.889341 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1e1ad36c-3452-4567-9c16-3d7790968cda up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:43.965799 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0d085c29-3891-42d5-88ce-86da4b66a1d1 req-36020878-74ab-4958-9291-32b436698983 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6085637 May 20 20:28:43.995186 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0588381e-2671-4531-b7f2-278dfd89e7be req-4d6e860c-75b2-4e66-aefe-6cd8bf80d2ce tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2922525 May 20 20:28:44.009711 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03354eda-ad32-4e62-99cd-01ef11099a10 None None] Provisioning for port 97184dad-75cc-4d84-b739-0ac5a43dc683 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:44.039814 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03354eda-ad32-4e62-99cd-01ef11099a10 None None] Provisioning complete for port 97184dad-75cc-4d84-b739-0ac5a43dc683 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:44.040535 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03354eda-ad32-4e62-99cd-01ef11099a10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.043240 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.146794 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03354eda-ad32-4e62-99cd-01ef11099a10 None None] Port 97184dad-75cc-4d84-b739-0ac5a43dc683 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:28:44.155098 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 1e1ad36c-3452-4567-9c16-3d7790968cda completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:44.163342 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 1e1ad36c-3452-4567-9c16-3d7790968cda triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:44.163779 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.187996 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-30007c7a-aefa-4d86-a2cf-d0d338c7b25e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:44.189488 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-30007c7a-aefa-4d86-a2cf-d0d338c7b25e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 818 time: 0.2978985 May 20 20:28:44.211155 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.219407 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.227693 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-1618f1ca-8c33-4cdf-99ea-384aa1db9c98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:44.237767 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-8312ff04-8a24-4314-afe2-07b7ab4f652f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/quotas/d7d330ce02bc4a5b849c6cd53ef67558 HTTP/1.1" status: 200 len: 375 time: 0.0380538 May 20 20:28:44.309797 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e47444402f4248d7be4ac884e38cbcdf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6087475 May 20 20:28:44.313107 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.314424 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38440) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:44.315590 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2465997-cb2f-4725-9f35-7f2d65bde623,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:44.320985 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:44.323419 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-26727fe0-b109-4490-b5cb-063f673eaab0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:44.326431 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-26727fe0-b109-4490-b5cb-063f673eaab0 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 1096 time: 0.2692971 May 20 20:28:44.344954 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 1e1ad36c-3452-4567-9c16-3d7790968cda, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=1e1ad36c-3452-4567-9c16-3d7790968cda,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:44.351168 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.352332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1d502ad2-ac9d-401d-ac74-575c2dae4457 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:44.380851 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:44.406456 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-0e8d34d2-b5f9-4337-a654-e56e2fb3f1f4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Synchronizing usage tracker for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:44.416472 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.451939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.467138 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-0e8d34d2-b5f9-4337-a654-e56e2fb3f1f4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Unset dirty status for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:44.468229 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-0e8d34d2-b5f9-4337-a654-e56e2fb3f1f4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2165477 May 20 20:28:44.477612 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.483648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.484186 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=1e1ad36c-3452-4567-9c16-3d7790968cda,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:44.485045 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.488694 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:44.490375 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:44.498759 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 1d502ad2-ac9d-401d-ac74-575c2dae4457 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:44.505036 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 1d502ad2-ac9d-401d-ac74-575c2dae4457 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:44.505844 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.595953 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Pushing event updated for resources: {'Port': ['ID=97184dad-75cc-4d84-b739-0ac5a43dc683,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:44.599010 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:44.635264 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.654022 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 1d502ad2-ac9d-401d-ac74-575c2dae4457, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=1d502ad2-ac9d-401d-ac74-575c2dae4457,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:44.659820 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.662137 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:44.708987 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.717755 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Network 41de6d5d-bea0-49fe-8865-f88749093770 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:44.718961 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:44.721787 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e79e7bfc-bd22-4353-8241-0999b4cfd95b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:44.735132 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=1d502ad2-ac9d-401d-ac74-575c2dae4457,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:44.743304 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2465997-cb2f-4725-9f35-7f2d65bde623,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:44.749820 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:44.752049 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:44.765369 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-755af23e-b050-4514-94b3-51c627adc92a service neutron] 10.222.0.82 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2827194 May 20 20:28:44.802418 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:44.806913 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a2465997-cb2f-4725-9f35-7f2d65bde623 HTTP/1.1" status: 204 len: 168 time: 0.4882777 May 20 20:28:44.922633 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-89b23490-b7eb-4810-9e4d-4ab991af4347 service neutron] 10.222.0.82 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1569276 May 20 20:28:44.990843 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:28:45.108817 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-98b0b28e-2c01-44a0-85ac-2188e0aece3a None None] Provisioning complete for port 97184dad-75cc-4d84-b739-0ac5a43dc683 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:45.109307 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-98b0b28e-2c01-44a0-85ac-2188e0aece3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:45.232553 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:28:45.242659 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] 10.222.0.82 "PUT /v2.0/routers/9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2988706 May 20 20:28:45.278536 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-98b0b28e-2c01-44a0-85ac-2188e0aece3a None None] Port 97184dad-75cc-4d84-b739-0ac5a43dc683 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:28:45.685664 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1e1ad36c-3452-4567-9c16-3d7790968cda up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:45.758803 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 1e1ad36c-3452-4567-9c16-3d7790968cda triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:45.759198 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:45.882410 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1d502ad2-ac9d-401d-ac74-575c2dae4457 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:45.943131 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Sync routers for ids ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:45.954314 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Routers {'d41c5f32-65d4-42ea-8e08-4ee398ba1a44'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:45.955173 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:45.963822 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 1d502ad2-ac9d-401d-ac74-575c2dae4457 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:45.964207 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:46.145181 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Set router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:46.485608 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:40Z', 'revision_number': 4, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port': {'id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'c0fdfd3a-cf39-40ab-842f-b7613dba71a5', 'name': '', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'mac_address': 'fa:16:3e:76:02:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_interface', 'standard_attr_id': 298, 'fixed_ips': [{'subnet_id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:39Z', 'updated_at': '2021-05-20T20:28:41Z', 'revision_number': 2, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'subnets': [{'id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:46.491258 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Checking router: d41c5f32-65d4-42ea-8e08-4ee398ba1a44 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:46.491611 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Updating router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:28:46.553400 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:46.632323 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Sync routers for ids ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:28:46.641200 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Routers {'9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:46.641815 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:46.847112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Set router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:46.973553 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:46.986892 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Transition to ACTIVE for port object c0fdfd3a-cf39-40ab-842f-b7613dba71a5 will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:46.994919 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:46.999119 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-f169b1bd-2c89-4e3c-87d6-537c2b08b945 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:47.155411 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-847b75d4-b009-4a11-82bc-374593661525 None None] Pushing event updated for resources: {'Port': ['ID=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:47.162921 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-847b75d4-b009-4a11-82bc-374593661525 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:47.233833 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250'}], 'enable_snat': True}, 'gw_port_id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:43Z', 'revision_number': 4, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port': {'id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:9e:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '97184dad-75cc-4d84-b739-0ac5a43dc683', 'name': '', 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'mac_address': 'fa:16:3e:f5:a9:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'a224f1d0-85ff-4e37-8956-31561c5c3c98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:42Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 2, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'subnets': [{'id': 'a224f1d0-85ff-4e37-8956-31561c5c3c98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:47.239842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Checking router: 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:28:47.239842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Updating router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 port 97184dad-75cc-4d84-b739-0ac5a43dc683 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:28:47.246250 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Attempting to bind port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:47.246911 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Attempting to bind port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:47.247206 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Attempting to bind port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 on network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:47.255751 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:47.256444 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Checking segment: {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:47.257038 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:47.257614 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Bound using segment: {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:47.258269 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Bound port: c0fdfd3a-cf39-40ab-842f-b7613dba71a5, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:47.258966 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:47.309396 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:47.341919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-532f9e84-626c-4070-99c1-f359d4a42b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:47.344294 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-532f9e84-626c-4070-99c1-f359d4a42b4a service neutron] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 916 time: 0.1698549 May 20 20:28:47.373557 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] For port c0fdfd3a-cf39-40ab-842f-b7613dba71a5, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:47.378758 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] For port c0fdfd3a-cf39-40ab-842f-b7613dba71a5, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:47.385341 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:47.391739 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:47.472933 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Routers {'d41c5f32-65d4-42ea-8e08-4ee398ba1a44'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:47.473553 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:47.541611 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-847b75d4-b009-4a11-82bc-374593661525 None None] Pushing event updated for resources: {'Port': ['ID=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,revision_number=4']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:47.546273 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-847b75d4-b009-4a11-82bc-374593661525 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:47.674116 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] Set router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:47.734702 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device c0fdfd3a-cf39-40ab-842f-b7613dba71a5 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:47.768753 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:47.804284 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Transition to ACTIVE for port object 97184dad-75cc-4d84-b739-0ac5a43dc683 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:47.814242 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:47.820180 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:47.944060 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:47.976658 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:47.977245 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:48.042096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b30dc75-56bc-4ace-a9b4-c9798c3ecb83 None None] Pushing event updated for resources: {'Port': ['ID=97184dad-75cc-4d84-b739-0ac5a43dc683,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:48.055488 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-5b30dc75-56bc-4ace-a9b4-c9798c3ecb83 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:48.064312 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:40Z', 'revision_number': 4, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port': {'id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'c0fdfd3a-cf39-40ab-842f-b7613dba71a5', 'name': '', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'mac_address': 'fa:16:3e:76:02:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_interface', 'standard_attr_id': 298, 'fixed_ips': [{'subnet_id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:39Z', 'updated_at': '2021-05-20T20:28:47Z', 'revision_number': 4, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'subnets': [{'id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:48.070348 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ebd530c-3e89-4447-a1ce-9fcb3c0f16d8 None None] The sync data for ids ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'] in dv-cinder-784623-13-iscsi is: [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:40Z', 'revision_number': 4, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port': {'id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'c0fdfd3a-cf39-40ab-842f-b7613dba71a5', 'name': '', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'mac_address': 'fa:16:3e:76:02:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_interface', 'standard_attr_id': 298, 'fixed_ips': [{'subnet_id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:39Z', 'updated_at': '2021-05-20T20:28:47Z', 'revision_number': 4, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'subnets': [{'id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:48.141651 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Attempting to bind port 97184dad-75cc-4d84-b739-0ac5a43dc683 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:48.142053 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Attempting to bind port 97184dad-75cc-4d84-b739-0ac5a43dc683 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:48.142420 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Attempting to bind port 97184dad-75cc-4d84-b739-0ac5a43dc683 on network 41de6d5d-bea0-49fe-8865-f88749093770 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:48.152382 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:48.152775 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Checking segment: {'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:48.153187 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:48.153586 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Bound using segment: {'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:48.154471 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Bound port: 97184dad-75cc-4d84-b739-0ac5a43dc683, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f44e922f-ca7d-4170-be3d-efa9bae9e44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:48.155092 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:48.306726 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:48.341331 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] For port 97184dad-75cc-4d84-b739-0ac5a43dc683, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:48.344859 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] For port 97184dad-75cc-4d84-b739-0ac5a43dc683, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=97184dad-75cc-4d84-b739-0ac5a43dc683,segment=NetworkSegment(f44e922f-ca7d-4170-be3d-efa9bae9e44e),segment_id=f44e922f-ca7d-4170-be3d-efa9bae9e44e)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:48.352148 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:48.358030 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:48.402695 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port c0fdfd3a-cf39-40ab-842f-b7613dba71a5, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:48.415688 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:48.443205 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Routers {'9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:28:48.444212 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:48.504932 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b30dc75-56bc-4ace-a9b4-c9798c3ecb83 None None] Pushing event updated for resources: {'Port': ['ID=97184dad-75cc-4d84-b739-0ac5a43dc683,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:48.516359 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-5b30dc75-56bc-4ace-a9b4-c9798c3ecb83 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:48.517303 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.096s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:48.686751 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:48.692237 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:48.712321 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] Set router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:28:48.919848 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-cd3abd69-fccb-46aa-a334-627539ebbef2 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=08f701b8-1580-4323-b2f2-c088e14e4e28 HTTP/1.1" status: 200 len: 217 time: 0.1080508 May 20 20:28:49.047311 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-b98083ad-0ae6-47c9-b11e-c8293bb707d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:49.049110 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-b98083ad-0ae6-47c9-b11e-c8293bb707d8 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.1138406 May 20 20:28:49.121005 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38614) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:49.175334 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-1100ef3e-cf00-48dd-8045-1f8ae2f86948 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1144135 May 20 20:28:49.180299 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5090df16-1892-43dc-801a-e036eb0fbe1c req-f9ad3e58-681a-49ca-a115-1a3dc442bd8d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 210 time: 0.0561295 May 20 20:28:49.273066 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250'}], 'enable_snat': True}, 'gw_port_id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:43Z', 'revision_number': 4, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port': {'id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:9e:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '97184dad-75cc-4d84-b739-0ac5a43dc683', 'name': '', 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'mac_address': 'fa:16:3e:f5:a9:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'a224f1d0-85ff-4e37-8956-31561c5c3c98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:42Z', 'updated_at': '2021-05-20T20:28:48Z', 'revision_number': 4, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'subnets': [{'id': 'a224f1d0-85ff-4e37-8956-31561c5c3c98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:28:49.277717 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c5b8697-b095-4063-9fda-8fafce01f1a9 None None] The sync data for ids ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'] in dv-cinder-784623-13-iscsi is: [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250'}], 'enable_snat': True}, 'gw_port_id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:28:43Z', 'revision_number': 4, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port': {'id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:9e:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '97184dad-75cc-4d84-b739-0ac5a43dc683', 'name': '', 'network_id': '41de6d5d-bea0-49fe-8865-f88749093770', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'mac_address': 'fa:16:3e:f5:a9:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'a224f1d0-85ff-4e37-8956-31561c5c3c98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:42Z', 'updated_at': '2021-05-20T20:28:48Z', 'revision_number': 4, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'subnets': [{'id': 'a224f1d0-85ff-4e37-8956-31561c5c3c98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:28:49.430165 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:49.460084 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-fef7520d-6a0a-4ea7-8ee2-3773ab06550c service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2625542 May 20 20:28:49.468239 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:49.469109 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bdd5438-9fd2-4c01-9819-9d28f4aae0d2 req-72a25de7-3e0f-478d-bcc5-8604f2627587 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:49.475962 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Usage tracker for resource:security_group_rule and tenant:1c101c26a09f4593ab09c1393165d182 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:49.478812 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3bdd5438-9fd2-4c01-9819-9d28f4aae0d2 req-72a25de7-3e0f-478d-bcc5-8604f2627587 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 943 time: 0.3525703 May 20 20:28:49.484324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:49.491661 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:49.576385 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3bdd5438-9fd2-4c01-9819-9d28f4aae0d2 req-df21fe21-9c15-4fcd-99ab-0cba30506e82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965953 May 20 20:28:49.659146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:49.671791 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:49.736113 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-40f70392-ddad-4c50-a666-0bf976e70e51 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:49.759439 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1c101c26a09f4593ab09c1393165d182&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6372640 May 20 20:28:49.760305 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38644) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:49.812932 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64d5b260-15c9-4420-bd2a-813161a1aec5,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:49.827428 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:49.865070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:49.866671 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 97184dad-75cc-4d84-b739-0ac5a43dc683 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:49.892801 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:49.972038 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:49.974056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 97184dad-75cc-4d84-b739-0ac5a43dc683 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:49.977941 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-10ba2c42-0d56-420f-a59b-2afdb16a351a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:49.980213 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 97184dad-75cc-4d84-b739-0ac5a43dc683 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:49.992489 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:49.996390 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64d5b260-15c9-4420-bd2a-813161a1aec5,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:50.001594 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:50.006631 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.010784 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/64d5b260-15c9-4420-bd2a-813161a1aec5 HTTP/1.1" status: 204 len: 168 time: 0.2475712 May 20 20:28:50.029545 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ce9af50c-2de9-4501-b950-8e6aaf3d5670 req-57a8a3ed-6a9d-430d-ace2-e54974c11633 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5485909 May 20 20:28:50.103692 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-a8da466a-2956-4c07-8fa2-c1785186f49d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:50.104583 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-a8da466a-2956-4c07-8fa2-c1785186f49d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Synchronizing usage tracker for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:network {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:50.146903 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38656) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:50.153129 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1266536510', 'description': 'tempest-secgroup-smoke-1266536510 description', 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:50.163190 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-a8da466a-2956-4c07-8fa2-c1785186f49d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Unset dirty status for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:network {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:50.165332 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:50.167737 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-a8da466a-2956-4c07-8fa2-c1785186f49d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 818 time: 0.3625710 May 20 20:28:50.177241 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:50.181546 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:50.192723 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:50.218807 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.219281 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.271819 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:50.280279 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:50.285841 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:50.286379 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 97184dad-75cc-4d84-b739-0ac5a43dc683, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=97184dad-75cc-4d84-b739-0ac5a43dc683,segment=NetworkSegment(f44e922f-ca7d-4170-be3d-efa9bae9e44e),segment_id=f44e922f-ca7d-4170-be3d-efa9bae9e44e)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:50.291943 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.292622 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device c0fdfd3a-cf39-40ab-842f-b7613dba71a5 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:50.312538 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:50.339669 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-12ee1ea9-795d-4b04-aa45-96bed0ca5680 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/quotas/d7d330ce02bc4a5b849c6cd53ef67558 HTTP/1.1" status: 200 len: 375 time: 0.1636224 May 20 20:28:50.355958 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-e5ac7095-3d8e-4b2a-ae36-bb904f3db3f5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:50.496706 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.515621 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.523307 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d2730759-5200-4e6e-9259-cbbc01a10d50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:50.583678 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=97184dad-75cc-4d84-b739-0ac5a43dc683,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:50.589653 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:50.616447 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5ec7237a-3e86-4e4b-b272-c39dc89160c5,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:50.619894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:50.623630 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.631658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38672) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:50.637876 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:50.638397 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.640877 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.4927752 May 20 20:28:50.676859 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'security_group_rule': {'security_group_id': '5ec7237a-3e86-4e4b-b272-c39dc89160c5', 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:50.696267 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-8c3eba51-df1c-49b9-b3ed-6de8f00b284f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:50.698279 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-8c3eba51-df1c-49b9-b3ed-6de8f00b284f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 818 time: 0.5281370 May 20 20:28:50.704045 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:50.710115 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:50.713437 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:50.717822 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38678) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:50.720171 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-c7728467-4211-41b0-b646-ca74e4958a4c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3714051 May 20 20:28:50.724974 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:50.747108 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.761274 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Request body: {'port': {'device_id': '146c570a-0416-4de3-a927-1c1daa195300', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'admin_state_up': True, 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:50.772882 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:50.777531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Usage tracker for resource:security_group_rule and tenant:adfeb696a11a4369b0cc5379add354ae is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:50.781835 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:50.792649 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:50.932305 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 08f701b8-1580-4323-b2f2-c088e14e4e28 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:28:50.984743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.993589 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:50.995015 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.004022 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6602a804-75f2-4d85-9f56-695b0bc3eba4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:51.055356 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=adfeb696a11a4369b0cc5379add354ae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3340356 May 20 20:28:51.059260 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38684) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:51.061218 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58a7197-46d8-4d60-933d-1c895e443364 req-8d0a15f8-c601-4ed2-8a38-e0f61e8f713f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:51.062691 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d58a7197-46d8-4d60-933d-1c895e443364 req-8d0a15f8-c601-4ed2-8a38-e0f61e8f713f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 943 time: 0.1964130 May 20 20:28:51.063745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43b386fd-5119-46af-ae25-05e2745041da,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:51.069362 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:51.121464 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d58a7197-46d8-4d60-933d-1c895e443364 req-3a8ada08-e1dd-465a-8b10-f640eef544dd tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479016 May 20 20:28:51.128744 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 08f701b8-1580-4323-b2f2-c088e14e4e28, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=08f701b8-1580-4323-b2f2-c088e14e4e28,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:51.155704 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '08f701b8-1580-4323-b2f2-c088e14e4e28', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'port_id': '08f701b8-1580-4323-b2f2-c088e14e4e28', 'mac_address': 'fa:16:3e:64:7f:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8debe367-8908-48d3-a2e2-6afb3c3cda2a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:28:51.161926 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.170453 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:51.179888 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.181904 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-0c74dac0-e9cd-48b6-b14c-861a182ea557 service neutron] 10.222.0.82 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4488060 May 20 20:28:51.191712 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:51.194760 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3a67d8b7-dc02-4bca-a4c9-96037d9631fd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:51.220561 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.239032 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 08f701b8-1580-4323-b2f2-c088e14e4e28 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:28:51.254730 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 08f701b8-1580-4323-b2f2-c088e14e4e28, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=08f701b8-1580-4323-b2f2-c088e14e4e28,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:51.258822 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.260747 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:51.268369 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.270054 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6b650ef1-c109-4622-aba3-3a3634e5d210,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:51.285366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:51.328382 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=08f701b8-1580-4323-b2f2-c088e14e4e28,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:51.331938 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:51.335702 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.336891 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7041011 May 20 20:28:51.337639 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Made reservation on behalf of d7d330ce02bc4a5b849c6cd53ef67558 for: {'port': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:51.339821 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38688) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:51.340959 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.344896 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'security_group_rule': {'security_group_id': '5ec7237a-3e86-4e4b-b272-c39dc89160c5', 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:51.352514 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:51.356750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:51.359666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:51.365936 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:51.381897 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.382129 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.448992 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.453305 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.456050 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a8569a3e-dda6-469c-8b09-7bb3514beaad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:51.478435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dbd81d4a-e18b-4817-a9e0-8317bc0146de,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:51.485620 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:51.495753 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.499803 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-6b7f6af3-2c47-4b36-82ff-9be795f2ddbd service neutron] 10.222.0.82 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3042068 May 20 20:28:51.500225 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1593893 May 20 20:28:51.501237 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38694) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:51.506960 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'security_group_rule': {'security_group_id': '5ec7237a-3e86-4e4b-b272-c39dc89160c5', 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:51.513248 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:51.517633 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:51.521626 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.524678 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:51.528348 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d40d2860-de44-4f53-b68b-beaab12f00b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:51.531360 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:51.552594 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.553691 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43b386fd-5119-46af-ae25-05e2745041da,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:51.594687 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:51.626463 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Allocated IP 172.20.0.5 (4ab99f46-8cd1-404d-95ae-c95a8ddd9d72/2ad34b95-1b62-4f29-a7ba-63bf116ecc64/44eaea5c-405a-4120-95d6-2f5a1da3ac29) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:51.634206 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.643920 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.647158 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:51.675612 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba6978fc-387c-411c-9a0a-05f217c826a8,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:51.681414 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:51.689507 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.692079 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1898575 May 20 20:28:51.695856 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38700) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:51.702448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'security_group_rule': {'security_group_id': '5ec7237a-3e86-4e4b-b272-c39dc89160c5', 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:51.703324 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 97184dad-75cc-4d84-b739-0ac5a43dc683 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:51.711396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:51.711520 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.715897 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/43b386fd-5119-46af-ae25-05e2745041da HTTP/1.1" status: 204 len: 168 time: 0.6509707 May 20 20:28:51.716088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:51.719979 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:51.726651 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:51.757316 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.878664 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1a72d567-f8d0-47fb-ba23-aa43b3e56bcb req-15e3ced7-4c18-4fa2-87db-5a6347294269 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 210 time: 0.1065106 May 20 20:28:51.890176 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['08f701b8-1580-4323-b2f2-c088e14e4e28'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:28:51.899340 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.942061 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:51.966907 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:51.986613 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.000289 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.002844 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:52.073735 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ffaf5151-cba5-4235-a837-6de654d50abc,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:52.077645 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:52.100624 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.106246 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-53ab0f50-258b-44b7-983b-2b0e3a1b3bfc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4091465 May 20 20:28:52.107736 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38722) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:52.122911 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'security_group_rule': {'security_group_id': '5ec7237a-3e86-4e4b-b272-c39dc89160c5', 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:52.129821 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:52.138009 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:52.148117 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:52.154424 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 97184dad-75cc-4d84-b739-0ac5a43dc683 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:52.157044 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:52.166112 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:52.166972 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.180360 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:52.188494 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.193744 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:52.196119 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4404957 May 20 20:28:52.207236 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Pushing event updated for resources: {'Port': ['ID=44eaea5c-405a-4120-95d6-2f5a1da3ac29,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:52.211140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e0187230-71f0-4f45-b151-bf5734e8757e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:52.224092 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Request body: {'port': {'device_id': '146c570a-0416-4de3-a927-1c1daa195300', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:52.248941 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:52.271170 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.securitygroups_db [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Project bf9ff50b3c4f4f7e8afcf9c87cade238 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 20 20:28:52.278030 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.399738 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.505478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.520987 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.536890 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f624b85-b9a9-493d-8d0d-e622204a4db8 req-3d245a23-87b6-45e1-a1a9-683f388d21cf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:52.539877 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0f624b85-b9a9-493d-8d0d-e622204a4db8 req-3d245a23-87b6-45e1-a1a9-683f388d21cf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 944 time: 0.1767998 May 20 20:28:52.579872 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96c12239-28c6-4c75-be94-19a490b3878e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:52.620210 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3aa5b019-1c80-4f50-8b90-95ddfd5a621d,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:52.629940 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:52.643941 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.648185 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5325096 May 20 20:28:52.649136 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38740) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:52.655862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'security_group_rule': {'security_group_id': '5ec7237a-3e86-4e4b-b272-c39dc89160c5', 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:52.662900 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0f624b85-b9a9-493d-8d0d-e622204a4db8 req-afd03ce3-c509-49f3-9352-39c889d2e8d7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137264 May 20 20:28:52.666704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:52.671542 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:security_group_rule and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:52.676609 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:52.693951 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:52.711410 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.securitygroups_db [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Project bf9ff50b3c4f4f7e8afcf9c87cade238 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 20 20:28:52.722039 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.808988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.817884 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.820055 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-27b793de-d494-4df5-8e2e-683d692b5517 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:52.857489 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=615edc0a-81aa-40a6-a168-d850f5933666,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:52.872079 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:52.886345 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:52.887985 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e92dd459-c294-424d-b1c6-d92e5ece3dbf tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2384255 May 20 20:28:52.982745 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 44eaea5c-405a-4120-95d6-2f5a1da3ac29 {{(pid=91645) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:28:52.993131 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:53.012293 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Transition to ACTIVE for port object 44eaea5c-405a-4120-95d6-2f5a1da3ac29 will not be triggered until provisioned by entity L2. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:53.021070 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:53.026557 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f8b10ea0-4843-4433-8091-e171b12b0ab3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:53.104357 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f8c4b356-bdeb-4f17-9a15-04a10a9d785e req-e434c91f-b648-41f4-80e1-7902f4506a16 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 210 time: 0.0598800 May 20 20:28:53.221073 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Pushing event updated for resources: {'Port': ['ID=44eaea5c-405a-4120-95d6-2f5a1da3ac29,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:53.258531 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:53.259502 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Attempting to bind port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:53.259854 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Attempting to bind port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:53.260181 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Attempting to bind port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 on network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:53.266744 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 on network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:28:53.267259 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Attempting to bind port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 on network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:53.276767 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:53.277282 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Checking segment: {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:53.277678 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Bound using segment: {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'} {{(pid=91645) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:53.278605 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.managers [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Bound port: 44eaea5c-405a-4120-95d6-2f5a1da3ac29, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'}}] {{(pid=91645) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:53.278977 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:53.414854 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] For port 44eaea5c-405a-4120-95d6-2f5a1da3ac29, host hv-cinder-78462, cleared binding levels {{(pid=91645) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:53.418976 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] For port 44eaea5c-405a-4120-95d6-2f5a1da3ac29, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91645) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:53.425800 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:53.432002 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0af3fb7b-f3aa-4aa9-b6fd-71af6988c1c2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:53.513198 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:53.513815 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:53.515217 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] 10.222.0.69 "PUT /v2.0/ports/44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 200 len: 1093 time: 1.3027759 May 20 20:28:53.515697 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '146c570a-0416-4de3-a927-1c1daa195300', 'tag': '44eaea5c-405a-4120-95d6-2f5a1da3ac29'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:53.523845 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Pushing event updated for resources: {'Port': ['ID=44eaea5c-405a-4120-95d6-2f5a1da3ac29,revision_number=3']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:53.527450 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:53.563552 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '146c570a-0416-4de3-a927-1c1daa195300', 'tag': '44eaea5c-405a-4120-95d6-2f5a1da3ac29', 'status': 'completed', 'code': 200} May 20 20:28:53.683589 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e4cee060-3a36-45a5-8ef3-133fdd3b9079 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:53.685110 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-e4cee060-3a36-45a5-8ef3-133fdd3b9079 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1096 time: 0.0937846 May 20 20:28:53.717214 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38816) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:53.777300 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-717753e6-727f-4876-b421-24c7c5628807 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 200 len: 217 time: 0.0765841 May 20 20:28:53.944324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:53.971533 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-2746c594-a79a-437d-8980-75ed103bc3d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:53.973049 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-2746c594-a79a-437d-8980-75ed103bc3d0 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.1822352 May 20 20:28:53.978421 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:53.983198 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Usage tracker for resource:security_group_rule and tenant:904157e960334be5b80df2eda92350bf is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:53.986358 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:53.993546 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:54.059155 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b7ed221-3234-4571-8ea5-bd82295cde2a req-d3d9d56a-8e1d-43ce-b62e-19bfca5570eb tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:54.060699 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0b7ed221-3234-4571-8ea5-bd82295cde2a req-d3d9d56a-8e1d-43ce-b62e-19bfca5570eb tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 944 time: 0.2079794 May 20 20:28:54.062729 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-a9d71ec4-6d54-406a-91e5-837a7392aecb service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0655470 May 20 20:28:54.257513 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0b7ed221-3234-4571-8ea5-bd82295cde2a req-ca0893e6-f87b-49c3-9f68-69cd2399a5d7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1877961 May 20 20:28:54.332044 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-c8b2b61c-82be-43f9-a191-92f527a52670 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2346978 May 20 20:28:54.396190 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0f5b6dc9-350d-485c-aed3-bbca1e47fd65 req-6f8f8b98-4208-4f27-9e39-521d2531b597 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 210 time: 0.1117427 May 20 20:28:54.425657 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:54.443794 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-800bf84d-c1d4-4e50-bb16-3c1fd91a5822 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:54.445303 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-800bf84d-c1d4-4e50-bb16-3c1fd91a5822 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 818 time: 0.4024293 May 20 20:28:54.453225 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:54.471727 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0f3462bd-d1c6-45e9-a01d-d9ee929f017a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:54.499371 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Request body: {'port': {'device_id': '4a719272-e929-4463-9b07-480500fcb622', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'admin_state_up': True, 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:54.540341 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2c13827c-e594-4a81-a740-5ca9704c6120 req-317b3527-a317-4383-9028-f4efc2408316 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1923606 May 20 20:28:54.687795 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-16eeaf84-aa46-4c61-ba97-aa8e4c62f197 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:54.689286 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-16eeaf84-aa46-4c61-ba97-aa8e4c62f197 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1096 time: 0.0784712 May 20 20:28:54.710995 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=904157e960334be5b80df2eda92350bf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9926403 May 20 20:28:54.712116 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b46f87fe-bbf9-4103-b640-c4d75085010d,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:54.714463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38870) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:54.722379 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:54.824689 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:54.829633 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:54.833070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Usage tracker for resource:port and tenant:d7d330ce02bc4a5b849c6cd53ef67558 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:54.841690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:54.851149 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:54.851390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-b538056c-d7f8-48a7-881d-886e63ed1bad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:54.853082 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-b538056c-d7f8-48a7-881d-886e63ed1bad service neutron] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 919 time: 0.1482847 May 20 20:28:54.858196 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38878) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:54.868761 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:54.886448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Made reservation on behalf of d7d330ce02bc4a5b849c6cd53ef67558 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:54.889939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:54.953451 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 08f701b8-1580-4323-b2f2-c088e14e4e28 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:55.026695 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.042832 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:55.067214 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.070963 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b46f87fe-bbf9-4103-b640-c4d75085010d,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:55.077651 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:55.078652 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-d71d4351-1a30-4713-9f98-284438ddd830 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 200 len: 217 time: 0.1915073 May 20 20:28:55.084950 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:55.088903 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Usage tracker for resource:security_group_rule and tenant:12b98bab24234fcf9452edd0f040beed is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:55.091710 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 08f701b8-1580-4323-b2f2-c088e14e4e28 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:55.092427 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:55.099190 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 08f701b8-1580-4323-b2f2-c088e14e4e28 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:55.099578 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.136499 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.136704 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:55.137666 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b46f87fe-bbf9-4103-b640-c4d75085010d HTTP/1.1" status: 204 len: 168 time: 0.4174047 May 20 20:28:55.182974 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Allocated IP 172.20.0.4 (4ab99f46-8cd1-404d-95ae-c95a8ddd9d72/2ad34b95-1b62-4f29-a7ba-63bf116ecc64/158c47cc-29b6-4cf6-943a-0acad5faa050) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:55.193531 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-6b15d3c9-908e-4d33-8ca0-6b3b3cc2d678 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:55.193909 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-6b15d3c9-908e-4d33-8ca0-6b3b3cc2d678 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.0986042 May 20 20:28:55.274874 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-eeb67282-569b-48f0-9656-5ba41b919089 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0633523 May 20 20:28:55.291721 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.335448 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 08f701b8-1580-4323-b2f2-c088e14e4e28, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=08f701b8-1580-4323-b2f2-c088e14e4e28,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:28:55.337413 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94b16202-270d-4a17-8756-b78db90d62eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '08f701b8-1580-4323-b2f2-c088e14e4e28'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:55.345749 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.349230 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:55.455260 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.473538 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=08f701b8-1580-4323-b2f2-c088e14e4e28,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:55.477073 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:55.482969 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.523779 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94b16202-270d-4a17-8756-b78db90d62eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '08f701b8-1580-4323-b2f2-c088e14e4e28', 'code': 200} May 20 20:28:55.544048 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.572693 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fb5e0b18-6a50-4b43-aa7c-bb11ab0da452 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:55.583484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:55.602835 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:55.610489 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-1e25ca1e-d316-4887-9a27-0c0d4ee6caeb service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2940693 May 20 20:28:55.694939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:55.699237 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:55.706382 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:55.730324 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=12b98bab24234fcf9452edd0f040beed&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8708415 May 20 20:28:55.742968 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38908) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:55.815561 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4c7b1fc-9bfc-4b49-acd7-20ce73b78a5d,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:55.833857 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:55.878225 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7b503f0a-a05e-46c4-93eb-4ef1b6d14240 req-c83ede90-702f-43d7-bc7a-bc1f0701266a service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2667344 May 20 20:28:55.886195 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c596a8-b4b6-442a-b34e-91d2e085e43b req-b6a126f9-29f0-4e0f-9fb3-71042f8e0a58 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:55.887772 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d9c596a8-b4b6-442a-b34e-91d2e085e43b req-b6a126f9-29f0-4e0f-9fb3-71042f8e0a58 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.4230299 May 20 20:28:55.900797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Pushing event updated for resources: {'Port': ['ID=158c47cc-29b6-4cf6-943a-0acad5faa050,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:55.903991 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.301s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:55.959158 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d9c596a8-b4b6-442a-b34e-91d2e085e43b req-9b049749-77b0-418a-aad1-8eb8f0790d55 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645533 May 20 20:28:55.970489 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:55.971684 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.048028 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5546916 May 20 20:28:56.071239 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3da98d6-9d3d-482a-8060-920af728bf52 req-437dc74c-8495-4bfb-a753-9e02f7ed2a51 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:56.071718 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-c3da98d6-9d3d-482a-8060-920af728bf52 req-437dc74c-8495-4bfb-a753-9e02f7ed2a51 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Synchronizing usage tracker for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:56.083601 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Request body: {'port': {'device_id': '4a719272-e929-4463-9b07-480500fcb622', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:56.117834 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.173186 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0eae014-fd71-415b-a5e6-572d15242407 req-b14dd98b-1b8c-4f3d-affc-5efb2dc6583f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:56.174803 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c0eae014-fd71-415b-a5e6-572d15242407 req-b14dd98b-1b8c-4f3d-affc-5efb2dc6583f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 1098 time: 0.3731816 May 20 20:28:56.223742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-c3da98d6-9d3d-482a-8060-920af728bf52 req-437dc74c-8495-4bfb-a753-9e02f7ed2a51 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Unset dirty status for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:56.225123 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c3da98d6-9d3d-482a-8060-920af728bf52 req-437dc74c-8495-4bfb-a753-9e02f7ed2a51 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 931 time: 0.4522593 May 20 20:28:56.228433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.306654 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38926) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:56.367683 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c0eae014-fd71-415b-a5e6-572d15242407 req-335026a5-c120-4938-b124-8c675e6d2428 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1414206 May 20 20:28:56.401269 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.448526 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-169018634-network', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:56.451135 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c3da98d6-9d3d-482a-8060-920af728bf52 req-243b6252-d171-4c7d-9eb2-88c5c5b6bfc4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1953704 May 20 20:28:56.455013 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:56.462856 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Usage tracker for resource:network and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:56.470080 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:56.472064 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.477093 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:56.479187 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9339c5c9-e81d-45e9-8972-fba2e547d1d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:56.494598 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Made reservation on behalf of 7c0b04802f8b42819b613e195b66efb7 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:56.497552 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4c7b1fc-9bfc-4b49-acd7-20ce73b78a5d,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:56.498048 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.502567 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:56.514669 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.520353 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b4c7b1fc-9bfc-4b49-acd7-20ce73b78a5d HTTP/1.1" status: 204 len: 168 time: 0.7723053 May 20 20:28:56.520444 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.540151 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:56.546695 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:56.552720 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:56.560965 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:56.669356 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.673616 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.678365 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:56.712490 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] vlan segment allocate from pool success with {'vlan_id': 803, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:28:56.721378 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a280c5d3-c0db-4e96-8163-d76c7fb84fac,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:56.725140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:56.728216 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.728216 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Added segment 7e4d4e68-a93e-461b-b036-66f977f8b866 of type vlan for network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 May 20 20:28:56.757220 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.790575 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.792299 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:56.792941 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.798480 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:56.823156 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 158c47cc-29b6-4cf6-943a-0acad5faa050 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:28:56.831472 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.847276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Transition to ACTIVE for port object 158c47cc-29b6-4cf6-943a-0acad5faa050 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:56.850878 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:56.855861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:56.901299 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38942) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:56.914692 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Pushing event updated for resources: {'Network': ['ID=6a4c09f9-50d0-476e-a4d9-6333a5ec1132,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:56.918223 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6109772 May 20 20:28:56.919521 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:56.921438 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38946) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:56.927653 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:28:56.928147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Request body: {'subnet': {'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-169018634-subnet', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:56.933086 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:56.937109 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Usage tracker for resource:subnet and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:56.940754 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:56.946947 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:56.958428 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Made reservation on behalf of 7c0b04802f8b42819b613e195b66efb7 for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:28:56.960723 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.020763 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.153199 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Pushing event updated for resources: {'Port': ['ID=158c47cc-29b6-4cf6-943a-0acad5faa050,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:57.161879 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:57.194830 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:57.217317 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Usage tracker for resource:security_group_rule and tenant:d21aed000f2f486098b9ee2561887660 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:57.222666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:57.232909 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:57.276454 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Attempting to bind port 158c47cc-29b6-4cf6-943a-0acad5faa050 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:57.276871 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Attempting to bind port 158c47cc-29b6-4cf6-943a-0acad5faa050 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:57.277197 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Attempting to bind port 158c47cc-29b6-4cf6-943a-0acad5faa050 on network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:57.296502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Port 158c47cc-29b6-4cf6-943a-0acad5faa050 on network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:28:57.296820 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Attempting to bind port 158c47cc-29b6-4cf6-943a-0acad5faa050 on network 4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:57.311856 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:57.312193 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Checking segment: {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:57.312587 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Bound using segment: {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:57.313002 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Bound port: 158c47cc-29b6-4cf6-943a-0acad5faa050, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:57.313342 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.389988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-618bf752-63fe-4a13-8971-05cc30b1889e req-82940aad-5569-4911-9a41-92594cb57e0c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:57.391559 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-618bf752-63fe-4a13-8971-05cc30b1889e req-82940aad-5569-4911-9a41-92594cb57e0c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.2416494 May 20 20:28:57.404838 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.410436 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-73a5d2f3-789c-419e-a642-fafa4d857bf6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:57.497636 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cb4537c7-816d-4786-a91f-df295ad528b3,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:57.501099 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:57.505205 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-618bf752-63fe-4a13-8971-05cc30b1889e req-b6a70acc-26af-4bce-9250-f3b706cf1e52 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1051254 May 20 20:28:57.512222 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Checking segment: {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:57.512634 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Network hostable DHCP agents. Network: 6a4c09f9-50d0-476e-a4d9-6333a5ec1132, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:28:57.519717 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] For port 158c47cc-29b6-4cf6-943a-0acad5faa050, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:57.530754 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] For port 158c47cc-29b6-4cf6-943a-0acad5faa050, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=158c47cc-29b6-4cf6-943a-0acad5faa050,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:57.533173 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.537735 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.542795 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4ab6c99a-d289-4421-893d-0ccd46d20d00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:57.551525 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:28:57.563235 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 6a4c09f9-50d0-476e-a4d9-6333a5ec1132) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:57.574753 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:57.575354 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.580647 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d11a6c6-efee-44f4-8e7e-49079fec2988 None None] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:57.582303 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.629209 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:57.629824 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.631368 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] 10.222.0.69 "PUT /v2.0/ports/158c47cc-29b6-4cf6-943a-0acad5faa050 HTTP/1.1" status: 200 len: 1093 time: 1.5700042 May 20 20:28:57.631875 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a719272-e929-4463-9b07-480500fcb622', 'tag': '158c47cc-29b6-4cf6-943a-0acad5faa050'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:28:57.650333 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d21aed000f2f486098b9ee2561887660&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7467709 May 20 20:28:57.653167 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 38962) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:57.657735 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Pushing event updated for resources: {'Port': ['ID=158c47cc-29b6-4cf6-943a-0acad5faa050,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:57.667998 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7454495 May 20 20:28:57.669080 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 38966) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:28:57.672248 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:57.672847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-08dea5a0-9cb3-4065-806e-b116650019a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.074s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:57.685477 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:28:57.691600 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:28:57.707155 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Usage tracker for resource:router and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:28:57.709596 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a719272-e929-4463-9b07-480500fcb622', 'tag': '158c47cc-29b6-4cf6-943a-0acad5faa050', 'status': 'completed', 'code': 200} May 20 20:28:57.711352 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:28:57.719879 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:28:57.726911 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e70fa25-279b-42fb-9d9d-81aa7bbeae18,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:57.733328 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:57.751149 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb3be07-5bec-41e0-89c6-baa9c3b8f6ee req-c2c1475d-47b8-4401-992b-2dd0f05cb9e8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:28:57.751937 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-3cb3be07-5bec-41e0-89c6-baa9c3b8f6ee req-c2c1475d-47b8-4401-992b-2dd0f05cb9e8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Synchronizing usage tracker for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:57.757299 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.758242 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.775014 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-3cb3be07-5bec-41e0-89c6-baa9c3b8f6ee req-c2c1475d-47b8-4401-992b-2dd0f05cb9e8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Unset dirty status for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:57.776201 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3cb3be07-5bec-41e0-89c6-baa9c3b8f6ee req-c2c1475d-47b8-4401-992b-2dd0f05cb9e8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 943 time: 0.1808014 May 20 20:28:57.776949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.785952 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.814276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.851855 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:28:57.852657 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.855050 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-3cb3be07-5bec-41e0-89c6-baa9c3b8f6ee req-a36f4a8a-2cf7-466a-9fde-6df8149e0710 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Synchronizing usage tracker for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:28:57.895263 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.899168 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f42bce4a-755f-4f9a-a545-b78dad9fcbc1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:57.915075 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e70fa25-279b-42fb-9d9d-81aa7bbeae18,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:57.917873 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:57.919575 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:57.922983 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9e70fa25-279b-42fb-9d9d-81aa7bbeae18 HTTP/1.1" status: 204 len: 168 time: 0.2649009 May 20 20:28:58.046035 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Allocated IP 172.20.0.2 (6a4c09f9-50d0-476e-a4d9-6333a5ec1132/cb4537c7-816d-4786-a91f-df295ad528b3/785388a0-6998-435c-84ea-e4eb7f89b000) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:58.151644 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-3cb3be07-5bec-41e0-89c6-baa9c3b8f6ee req-a36f4a8a-2cf7-466a-9fde-6df8149e0710 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Unset dirty status for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:28:58.152822 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3cb3be07-5bec-41e0-89c6-baa9c3b8f6ee req-a36f4a8a-2cf7-466a-9fde-6df8149e0710 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3652825 May 20 20:28:58.226786 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.283121 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.294895 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Transition to ACTIVE for port object 785388a0-6998-435c-84ea-e4eb7f89b000 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:58.314190 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Transition to ACTIVE for port object 785388a0-6998-435c-84ea-e4eb7f89b000 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:28:58.321838 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.326847 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:58.396517 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:58.400937 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:58.404760 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:58.484909 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Pushing event updated for resources: {'Port': ['ID=785388a0-6998-435c-84ea-e4eb7f89b000,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:58.492622 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:58.516187 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Attempting to bind port 785388a0-6998-435c-84ea-e4eb7f89b000 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:28:58.517520 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Attempting to bind port 785388a0-6998-435c-84ea-e4eb7f89b000 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:28:58.518799 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Attempting to bind port 785388a0-6998-435c-84ea-e4eb7f89b000 on network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:28:58.527976 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:28:58.531158 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Checking segment: {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:28:58.531896 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.532480 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Bound using segment: {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:28:58.533736 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Bound port: 785388a0-6998-435c-84ea-e4eb7f89b000, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:28:58.533990 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.631686 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.639693 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] For port 785388a0-6998-435c-84ea-e4eb7f89b000, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:28:58.643581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] For port 785388a0-6998-435c-84ea-e4eb7f89b000, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=785388a0-6998-435c-84ea-e4eb7f89b000,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:28:58.663010 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.666005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:58.668378 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:58.750833 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Pushing event updated for resources: {'Port': ['ID=785388a0-6998-435c-84ea-e4eb7f89b000,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:58.754437 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:58.822868 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Allocated IP 172.27.3.21 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/5e4628b0-fac4-4325-b7b1-0bc70616d12e) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:28:59.012367 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:59.049131 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:59.053154 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:28:59.124928 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:28:59.128292 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:28:59.132195 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:28:59.187981 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Pushing event updated for resources: {'Port': ['ID=5e4628b0-fac4-4325-b7b1-0bc70616d12e,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:28:59.198584 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:28:59.518652 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:28:59.756307 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 785388a0-6998-435c-84ea-e4eb7f89b000 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:28:59.838904 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57b5f0fe-1e24-4392-a656-58afe2d4009b None None] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:28:59.937792 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 785388a0-6998-435c-84ea-e4eb7f89b000 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:59.963668 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Provisioning for port 785388a0-6998-435c-84ea-e4eb7f89b000 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:28:59.971648 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Provisioning complete for port 785388a0-6998-435c-84ea-e4eb7f89b000 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:28:59.971999 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:00.063907 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:00.203455 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:00.244788 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] For port 785388a0-6998-435c-84ea-e4eb7f89b000, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=785388a0-6998-435c-84ea-e4eb7f89b000,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:00.254980 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:00.257947 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:00.297963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Router 9e724689-d805-445f-92ab-29fb6d9724fc is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91645) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:29:00.343388 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Pushing event updated for resources: {'Port': ['ID=785388a0-6998-435c-84ea-e4eb7f89b000,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:00.356062 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:00.499056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-fc8751e8-307b-4d97-8f59-17fc7fda1e98 None None] Provisioning complete for port 785388a0-6998-435c-84ea-e4eb7f89b000 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:00.499512 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-fc8751e8-307b-4d97-8f59-17fc7fda1e98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:00.504197 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:29:00.515024 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Sync routers for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:29:00.531047 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:00.532197 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-d5b06341-13cb-4ecd-ae8b-d5e91ef752fa admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 2.8609869 May 20 20:29:00.535741 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39050) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:00.536414 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:00.538384 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:00.786742 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:00.920671 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39062) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:01.059119 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.074550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:01.078444 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Usage tracker for resource:security_group_rule and tenant:9bcb026da7bf48f8b58ab8ff9b74b05e is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:01.082725 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:01.088498 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:01.128489 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:28:59Z', 'revision_number': 3, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:28:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:01.132777 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Checking router: 9e724689-d805-445f-92ab-29fb6d9724fc for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:29:01.133437 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Updating router 9e724689-d805-445f-92ab-29fb6d9724fc port 5e4628b0-fac4-4325-b7b1-0bc70616d12e binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:29:01.182006 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.187057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.195276 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.196764 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8f6087b4-5b00-415d-bef1-48f95df24696 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:01.242093 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9bcb026da7bf48f8b58ab8ff9b74b05e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3216071 May 20 20:29:01.244743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39068) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:01.256455 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=069546ce-42b8-4590-8711-d60344639c93,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:01.264778 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:01.324649 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.355738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.380338 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.419320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.423317 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c59bde45-6703-4d27-a146-4dd5e12a5ec2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:01.439475 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=069546ce-42b8-4590-8711-d60344639c93,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:01.442060 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.445465 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/069546ce-42b8-4590-8711-d60344639c93 HTTP/1.1" status: 204 len: 168 time: 0.1973093 May 20 20:29:01.445465 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:01.574524 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.588495 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Transition to ACTIVE for port object 5e4628b0-fac4-4325-b7b1-0bc70616d12e will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:01.594487 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.599474 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:01.610594 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Allocated IP 172.20.0.1 (6a4c09f9-50d0-476e-a4d9-6333a5ec1132/cb4537c7-816d-4786-a91f-df295ad528b3/93b0417e-99f4-4721-9a41-9257895317c2) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:29:01.664970 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d4c5cb-3539-4eaf-ace4-dcd4be496e1e None None] Pushing event updated for resources: {'Port': ['ID=5e4628b0-fac4-4325-b7b1-0bc70616d12e,revision_number=2']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:01.668136 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-97d4c5cb-3539-4eaf-ace4-dcd4be496e1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:01.692130 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Attempting to bind port 5e4628b0-fac4-4325-b7b1-0bc70616d12e on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:29:01.692749 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Attempting to bind port 5e4628b0-fac4-4325-b7b1-0bc70616d12e by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:29:01.693133 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Attempting to bind port 5e4628b0-fac4-4325-b7b1-0bc70616d12e on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:01.698757 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 28, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:29:01.699017 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:01.699381 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.699876 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:29:01.700353 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Bound port: 5e4628b0-fac4-4325-b7b1-0bc70616d12e, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:29:01.700781 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.705969 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 785388a0-6998-435c-84ea-e4eb7f89b000 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:01.787500 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 785388a0-6998-435c-84ea-e4eb7f89b000 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:01.787942 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.801153 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] For port 5e4628b0-fac4-4325-b7b1-0bc70616d12e, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:29:01.801523 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39078) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:01.802068 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] For port 5e4628b0-fac4-4325-b7b1-0bc70616d12e, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=5e4628b0-fac4-4325-b7b1-0bc70616d12e,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:29:01.807839 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.819836 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-847b75d4-b009-4a11-82bc-374593661525 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:01.828617 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.845552 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:01.849100 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.851927 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Usage tracker for resource:security_group_rule and tenant:9ad32130a1f849ee8deb5f77d50e7662 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:01.856111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:01.864027 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:01.886291 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Transition to ACTIVE for port object 93b0417e-99f4-4721-9a41-9257895317c2 will not be triggered until provisioned by entity DHCP. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:01.926779 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.935865 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f12e1df9-a859-48dc-869d-4ecab6372df0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:01.967481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.971610 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:01.972849 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:01.973810 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:01.983791 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-71e74466-f617-4550-8fb7-5c6f51bf56d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:02.003058 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:02.006708 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:02.009727 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44eaea5c-405a-4120-95d6-2f5a1da3ac29 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:29:02.022332 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:29:02.022808 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.036777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95f9875e-98d1-4af7-8f5e-1f873eacfe46,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:02.050278 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:02.069696 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9ad32130a1f849ee8deb5f77d50e7662&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2663224 May 20 20:29:02.072364 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39084) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:02.089022 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d4c5cb-3539-4eaf-ace4-dcd4be496e1e None None] Pushing event updated for resources: {'Port': ['ID=5e4628b0-fac4-4325-b7b1-0bc70616d12e,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:02.098619 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-97d4c5cb-3539-4eaf-ace4-dcd4be496e1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:02.101033 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Pushing event updated for resources: {'Port': ['ID=93b0417e-99f4-4721-9a41-9257895317c2,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:02.105417 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:02.273153 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.315115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.332139 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 44eaea5c-405a-4120-95d6-2f5a1da3ac29, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:02.350966 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '44eaea5c-405a-4120-95d6-2f5a1da3ac29', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'port_id': '44eaea5c-405a-4120-95d6-2f5a1da3ac29', 'mac_address': 'fa:16:3e:e8:1b:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 833, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:29:02.374512 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:02.396505 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.417010 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-6706f8b9-ff23-42ec-be52-441aaf2ad8d8 None None] Provisioning for port 93b0417e-99f4-4721-9a41-9257895317c2 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:02.429351 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-6706f8b9-ff23-42ec-be52-441aaf2ad8d8 None None] Provisioning complete for port 93b0417e-99f4-4721-9a41-9257895317c2 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:02.429717 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6706f8b9-ff23-42ec-be52-441aaf2ad8d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.430405 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e43ebd-4dff-4440-8a50-57688c9b48f6 req-06c23c0d-4a81-4c5e-9dc4-d941f024dd4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:02.431962 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-28e43ebd-4dff-4440-8a50-57688c9b48f6 req-06c23c0d-4a81-4c5e-9dc4-d941f024dd4b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 1096 time: 0.2677279 May 20 20:29:02.480567 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.490086 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:02.490842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-6706f8b9-ff23-42ec-be52-441aaf2ad8d8 None None] Port 93b0417e-99f4-4721-9a41-9257895317c2 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:29:02.494214 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.515420 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 44eaea5c-405a-4120-95d6-2f5a1da3ac29 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:29:02.531355 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4010456-2347-44d2-a84b-8d8029e3ab8c req-1b37e958-6cc4-4543-b185-8974841b3e55 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:02.533282 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c4010456-2347-44d2-a84b-8d8029e3ab8c req-1b37e958-6cc4-4543-b185-8974841b3e55 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 943 time: 0.1945658 May 20 20:29:02.533525 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 44eaea5c-405a-4120-95d6-2f5a1da3ac29, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:02.534406 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95f9875e-98d1-4af7-8f5e-1f873eacfe46,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:02.542101 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:02.547003 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.550704 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-d81f6ab1-167c-479d-a326-fb35710983f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:02.588436 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80599f2-954a-46bc-8676-43b357a9e1d6 req-65d7de69-5b58-4781-b60d-1311b55d7d9a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:02.590842 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f80599f2-954a-46bc-8676-43b357a9e1d6 req-65d7de69-5b58-4781-b60d-1311b55d7d9a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.2695050 May 20 20:29:02.594335 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.598076 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/95f9875e-98d1-4af7-8f5e-1f873eacfe46 HTTP/1.1" status: 204 len: 168 time: 0.5219855 May 20 20:29:02.647545 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=44eaea5c-405a-4120-95d6-2f5a1da3ac29,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:02.661130 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:02.666785 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c4010456-2347-44d2-a84b-8d8029e3ab8c req-aa86ffd1-09b2-43b9-b9ae-8fdf7d6be751 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0793521 May 20 20:29:02.689020 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e43ebd-4dff-4440-8a50-57688c9b48f6 req-55937b84-146d-4d34-9c3a-f0310ca9599f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:02.692497 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-28e43ebd-4dff-4440-8a50-57688c9b48f6 req-55937b84-146d-4d34-9c3a-f0310ca9599f service neutron] 10.222.0.69 "GET /v2.0/networks?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&shared=False HTTP/1.1" status: 200 len: 919 time: 0.2379999 May 20 20:29:02.796653 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:28:59Z', 'revision_number': 3, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:02.802627 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70af6ce1-f284-4d48-8e26-2ebe6400f287 None None] The sync data for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi is: [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:28:59Z', 'revision_number': 3, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:29:02.821874 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f80599f2-954a-46bc-8676-43b357a9e1d6 req-910351c7-0582-4853-bc1b-947c49825874 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0777411 May 20 20:29:02.854305 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.860804 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.861820 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:02.867449 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0daf6425-1a78-4c57-b687-f918476a1baa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:02.902010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e43ebd-4dff-4440-8a50-57688c9b48f6 req-51a1cefd-e462-42cc-b288-1a88f23c4b42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:02.903839 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-28e43ebd-4dff-4440-8a50-57688c9b48f6 req-51a1cefd-e462-42cc-b288-1a88f23c4b42 service neutron] 10.222.0.69 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1949620 May 20 20:29:03.143937 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-9090c4e0-60b3-4f86-ae86-be765852cbbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:03.161579 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-9090c4e0-60b3-4f86-ae86-be765852cbbf service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 1096 time: 0.1921873 May 20 20:29:03.187176 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:03.189049 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:03.195457 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Pushing event updated for resources: {'Port': ['ID=93b0417e-99f4-4721-9a41-9257895317c2,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:03.198699 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.331s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:03.370981 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['44eaea5c-405a-4120-95d6-2f5a1da3ac29'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:29:03.420494 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-3be155e8-0837-4de3-a1b0-3fdafc46ba26 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=158c47cc-29b6-4cf6-943a-0acad5faa050 HTTP/1.1" status: 200 len: 217 time: 0.2422760 May 20 20:29:03.454727 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Router 9e724689-d805-445f-92ab-29fb6d9724fc has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:29:03.555353 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-a9a660b9-b952-4d5b-bcce-8a40eacda598 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:03.557997 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-a9a660b9-b952-4d5b-bcce-8a40eacda598 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.1208675 May 20 20:29:03.625614 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-9425f775-e97c-48f0-8574-47f54d9f4051 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0591390 May 20 20:29:03.685544 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-5c8c4dc8-8848-4c69-b997-f1317987486b None None] Provisioning complete for port 93b0417e-99f4-4721-9a41-9257895317c2 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:03.686212 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c8c4dc8-8848-4c69-b997-f1317987486b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:03.777647 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-5c8c4dc8-8848-4c69-b997-f1317987486b None None] Port 93b0417e-99f4-4721-9a41-9257895317c2 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:29:03.781440 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 5e4628b0-fac4-4325-b7b1-0bc70616d12e up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:03.818688 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:29:03.847728 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] 10.222.0.82 "PUT /v2.0/routers/9e724689-d805-445f-92ab-29fb6d9724fc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3103349 May 20 20:29:03.911987 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 5e4628b0-fac4-4325-b7b1-0bc70616d12e completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:03.920547 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 5e4628b0-fac4-4325-b7b1-0bc70616d12e triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:03.921058 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:04.062705 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-69b9e30f-ccb8-42a3-8344-bc14397fc46e service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4228475 May 20 20:29:04.133823 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:04.170839 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 5e4628b0-fac4-4325-b7b1-0bc70616d12e, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=5e4628b0-fac4-4325-b7b1-0bc70616d12e,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:04.181335 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:04.185107 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:04.316139 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=5e4628b0-fac4-4325-b7b1-0bc70616d12e,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:04.320679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:04.334367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b810f86b-1c5a-46f6-ad1c-7965620cbf2e req-1adeeab8-a971-4af8-b2ce-e3cd07ffdcc4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:04.335942 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b810f86b-1c5a-46f6-ad1c-7965620cbf2e req-1adeeab8-a971-4af8-b2ce-e3cd07ffdcc4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 943 time: 0.3916814 May 20 20:29:04.431036 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea6ace12-0224-4b09-9b91-3c0739755d52 req-624ceb95-e48b-43ad-b9f3-2bad2847b559 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3520644 May 20 20:29:04.467928 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b810f86b-1c5a-46f6-ad1c-7965620cbf2e req-8e5a33b2-40ee-4121-9b4e-f4844959c3b4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756488 May 20 20:29:04.481876 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c879dd51-2f6d-47ae-a77e-0302728ba411 req-877dedb6-86db-436e-a17e-f93142589fa7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:04.493545 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c879dd51-2f6d-47ae-a77e-0302728ba411 req-877dedb6-86db-436e-a17e-f93142589fa7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.4029181 May 20 20:29:04.506772 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-df00c16f-4c82-4f9f-b8c7-207bbba71daa service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1669211 May 20 20:29:04.558801 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c879dd51-2f6d-47ae-a77e-0302728ba411 req-71193160-68df-4954-996c-3d2902bff999 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643258 May 20 20:29:04.765130 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-34e9f804-cde2-46a0-89bc-bac68d85e5cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:04.774091 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-4a80d322-c8b0-47d9-b606-08ee92fc3d65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:04.775794 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-4a80d322-c8b0-47d9-b606-08ee92fc3d65 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 1099 time: 0.1104910 May 20 20:29:04.890422 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39154) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:04.897248 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1616390154-network', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:04.907005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:04.918161 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Usage tracker for resource:network and tenant:c4e2e503546247aab6ddc6897b8f0a03 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:04.922836 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:04.941247 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:04.957866 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Made reservation on behalf of c4e2e503546247aab6ddc6897b8f0a03 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:29:04.966729 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:04.996481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-2e1998a7-422c-41f8-ac72-d3c422a3f1e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:04.998657 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-2e1998a7-422c-41f8-ac72-d3c422a3f1e1 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 916 time: 0.1924124 May 20 20:29:05.002905 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.024528 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:05.030477 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Usage tracker for resource:security_group_rule and tenant:c4e2e503546247aab6ddc6897b8f0a03 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:05.034476 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:05.042148 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:05.116136 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-480cee92-9be4-4b2e-9b80-49ada5f4e398 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4 HTTP/1.1" status: 200 len: 217 time: 0.0949056 May 20 20:29:05.187816 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-74dc9c40-b82a-4cb3-a65e-e2f0604c0718 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:05.188859 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.191503 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-74dc9c40-b82a-4cb3-a65e-e2f0604c0718 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.0687561 May 20 20:29:05.194371 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.198991 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f789b1ae-5acb-4b42-8d1f-14de14bb5796 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:05.225982 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Sync routers for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:29:05.244447 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] vlan segment allocate from pool success with {'vlan_id': 817, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:29:05.244782 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:05.245491 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:28:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:05.255002 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92073739-adb9-4180-aa11-45e7cb9a2dec,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:05.258626 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:05.263217 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.263453 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Added segment 7b4463bd-2158-48b1-8d03-82ca3dc654d2 of type vlan for network 6821d522-feb4-4c2d-b828-7644a8c51b07 May 20 20:29:05.287480 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-e557622c-9228-48ae-afb7-b6d4a17b13e5 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0734849 May 20 20:29:05.298089 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.338573 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.338573 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:05.338573 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.356576 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:05.481319 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5896864 May 20 20:29:05.487207 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39174) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:05.490121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Pushing event updated for resources: {'Network': ['ID=6821d522-feb4-4c2d-b828-7644a8c51b07,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:05.492897 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:05.497343 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Request body: {'subnet': {'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1616390154-subnet', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:05.503698 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:05.508976 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Usage tracker for resource:subnet and tenant:c4e2e503546247aab6ddc6897b8f0a03 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:05.512555 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:05.521190 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:05.534548 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Made reservation on behalf of c4e2e503546247aab6ddc6897b8f0a03 for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:29:05.538078 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:05.581692 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-a7b4ce5b-49d5-4146-9964-f85ede8ff2fb service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2831028 May 20 20:29:05.697178 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:06.053395 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:29:06.181415 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef130c7-8521-4f7e-b200-3d7d1a162515 req-32cca8d8-809d-412f-89ff-ec1ad03910d5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:06.188848 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ef130c7-8521-4f7e-b200-3d7d1a162515 req-32cca8d8-809d-412f-89ff-ec1ad03910d5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 943 time: 0.4490230 May 20 20:29:06.237672 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86dcf2f6-c3c2-4e20-9185-2a040e53e0b1 req-785c50d8-cbe3-4e4b-82c7-e4462397d774 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6415029 May 20 20:29:06.244267 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 5e4628b0-fac4-4325-b7b1-0bc70616d12e up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:06.245673 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:06.254039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:06.290163 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ef130c7-8521-4f7e-b200-3d7d1a162515 req-9ac2e472-e8ee-41da-93dd-cb641e7317ff tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0995092 May 20 20:29:06.351262 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Checking segment: {'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:06.351617 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Network hostable DHCP agents. Network: 6821d522-feb4-4c2d-b828-7644a8c51b07, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:29:06.380074 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 5e4628b0-fac4-4325-b7b1-0bc70616d12e triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:06.380679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:06.381344 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6678003c-d218-460d-b219-200282a61c74,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:06.385639 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:06.390154 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:29:06.414203 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 6821d522-feb4-4c2d-b828-7644a8c51b07) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:06.428521 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:06.429123 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:06.456817 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39208) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:06.462437 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:06.465593 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.9768586 May 20 20:29:06.467644 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:06.473029 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Usage tracker for resource:router and tenant:c4e2e503546247aab6ddc6897b8f0a03 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:06.478693 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:06.484624 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9b948e1-93ad-47f5-8769-99f4ae680a8e None None] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:29:06.485374 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:06.497719 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:06.499646 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:06.518669 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:06.613588 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44eaea5c-405a-4120-95d6-2f5a1da3ac29 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:06.929569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:06.945938 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:06.946336 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:06.989313 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.069851 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-6821d522-feb4-4c2d-b828-7644a8c51b07', 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'fixed_ips': [{'subnet_id': '6678003c-d218-460d-b219-200282a61c74'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:29:07.071077 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.184927 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 2, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:07.221493 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Checking router: 9e724689-d805-445f-92ab-29fb6d9724fc for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:29:07.221874 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Updating router 9e724689-d805-445f-92ab-29fb6d9724fc port 93b0417e-99f4-4721-9a41-9257895317c2 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:29:07.324196 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.423234 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.437816 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.520065 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Allocated IP 172.20.0.2 (6821d522-feb4-4c2d-b828-7644a8c51b07/6678003c-d218-460d-b219-200282a61c74/e53897c6-5312-4f90-b7ac-8fc3aa8127e4) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:29:07.576087 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '146c570a-0416-4de3-a927-1c1daa195300', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44eaea5c-405a-4120-95d6-2f5a1da3ac29'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:29:07.596601 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5390baff-faad-43db-a863-4703169d9a04 req-808d65a8-ae24-4ea2-bfa2-5fc7920abfab tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:07.598122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.605585 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5390baff-faad-43db-a863-4703169d9a04 req-808d65a8-ae24-4ea2-bfa2-5fc7920abfab tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 943 time: 0.1040576 May 20 20:29:07.622267 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e0dea402-9d26-40de-870e-6a2b39fb3047 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.651841 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.660801 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5390baff-faad-43db-a863-4703169d9a04 req-2c0ae775-9f4b-4e17-ae2e-e15c34feab23 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540431 May 20 20:29:07.665159 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 44eaea5c-405a-4120-95d6-2f5a1da3ac29, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:07.683061 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '146c570a-0416-4de3-a927-1c1daa195300', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44eaea5c-405a-4120-95d6-2f5a1da3ac29', 'code': 200} May 20 20:29:07.686296 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:07.692583 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:07.824142 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Allocated IP 172.27.3.133 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/fc5c1c51-e5c6-402f-b1fb-66854c51120e) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:29:07.903294 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=44eaea5c-405a-4120-95d6-2f5a1da3ac29,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:07.920800 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:08.071138 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.082848 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.085502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8435ce4c-b6a9-4f32-af7c-810669c0f4c2 req-c01515f6-9692-474b-b62c-27d6c058019f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:08.086989 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8435ce4c-b6a9-4f32-af7c-810669c0f4c2 req-c01515f6-9692-474b-b62c-27d6c058019f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1098 time: 0.1348207 May 20 20:29:08.099712 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Transition to ACTIVE for port object e53897c6-5312-4f90-b7ac-8fc3aa8127e4 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:08.135123 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Transition to ACTIVE for port object e53897c6-5312-4f90-b7ac-8fc3aa8127e4 will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:08.151878 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8435ce4c-b6a9-4f32-af7c-810669c0f4c2 req-070399ba-c0b6-40bb-96f8-269ad140faea service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494759 May 20 20:29:08.161427 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.169021 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:08.220555 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.233610 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:08.237055 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:08.240901 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:29:08.248412 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-e5ac7095-3d8e-4b2a-ae36-bb904f3db3f5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:08.279566 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Pushing event updated for resources: {'Port': ['ID=fc5c1c51-e5c6-402f-b1fb-66854c51120e,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:08.288598 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:08.322412 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Pushing event updated for resources: {'Port': ['ID=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:08.330069 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:08.349637 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:08.352687 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:08.361785 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:29:08.382178 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.413732 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.472706 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Transition to ACTIVE for port object 93b0417e-99f4-4721-9a41-9257895317c2 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:08.497860 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.509878 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Attempting to bind port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:29:08.510355 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Attempting to bind port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:29:08.511166 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Attempting to bind port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 on network 6821d522-feb4-4c2d-b828-7644a8c51b07 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:08.523605 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-acce674a-e17a-4247-a9b3-e26e7c61a873 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:08.643643 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 29, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:29:08.644041 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Checking segment: {'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:08.644456 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.644863 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Bound using segment: {'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:29:08.645434 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Bound port: e53897c6-5312-4f90-b7ac-8fc3aa8127e4, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:29:08.645929 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:08.873174 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] For port e53897c6-5312-4f90-b7ac-8fc3aa8127e4, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:29:08.876782 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] For port e53897c6-5312-4f90-b7ac-8fc3aa8127e4, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,segment=NetworkSegment(7b4463bd-2158-48b1-8d03-82ca3dc654d2),segment_id=7b4463bd-2158-48b1-8d03-82ca3dc654d2)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:29:08.878975 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 158c47cc-29b6-4cf6-943a-0acad5faa050 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:29:09.038251 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 158c47cc-29b6-4cf6-943a-0acad5faa050, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=158c47cc-29b6-4cf6-943a-0acad5faa050,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:09.061037 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '158c47cc-29b6-4cf6-943a-0acad5faa050', 'network_id': '4ab99f46-8cd1-404d-95ae-c95a8ddd9d72', 'port_id': '158c47cc-29b6-4cf6-943a-0acad5faa050', 'mac_address': 'fa:16:3e:e3:3b:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 833, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ad34b95-1b62-4f29-a7ba-63bf116ecc64', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:29:09.067593 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.152128 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ee1707-111a-4953-b17c-07e5d12b442c req-69004ef7-3832-4f07-94b2-d3a56385f000 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:09.161084 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-95ee1707-111a-4953-b17c-07e5d12b442c req-69004ef7-3832-4f07-94b2-d3a56385f000 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 943 time: 0.1019406 May 20 20:29:09.164224 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.229480 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 158c47cc-29b6-4cf6-943a-0acad5faa050 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:29:09.241852 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-95ee1707-111a-4953-b17c-07e5d12b442c req-3d41ed11-f475-44fd-be7d-cea030750ea5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795527 May 20 20:29:09.247404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.311844 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc924bcc-3152-410a-b92c-cc9bbc228554 None None] Pushing event updated for resources: {'Port': ['ID=93b0417e-99f4-4721-9a41-9257895317c2,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:09.323596 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 158c47cc-29b6-4cf6-943a-0acad5faa050, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=158c47cc-29b6-4cf6-943a-0acad5faa050,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:09.324808 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-dc924bcc-3152-410a-b92c-cc9bbc228554 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.801s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:09.327327 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-a7ba4827-1ef1-450a-ba41-b844d850e110 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.242s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:09.381775 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.390562 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Attempting to bind port 93b0417e-99f4-4721-9a41-9257895317c2 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:29:09.390934 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Attempting to bind port 93b0417e-99f4-4721-9a41-9257895317c2 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:29:09.391298 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Attempting to bind port 93b0417e-99f4-4721-9a41-9257895317c2 on network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:09.405534 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 29, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:29:09.405915 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Checking segment: {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:09.406321 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.406718 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Bound using segment: {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:29:09.407205 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Bound port: 93b0417e-99f4-4721-9a41-9257895317c2, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:29:09.407574 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.490787 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-6ed3a5fc-a86b-4100-be6a-a06c84f2b95c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:09.492355 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-6ed3a5fc-a86b-4100-be6a-a06c84f2b95c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 0.7045758 May 20 20:29:09.526140 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Pushing event updated for resources: {'Port': ['ID=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:09.536380 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:09.536974 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.147s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:09.615751 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-f5a25e1c-952c-4a89-9f82-3fcc4f3c4722 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/quotas/6eec95c790c84cfc8a6a2fbd90bb926c HTTP/1.1" status: 200 len: 375 time: 0.1080704 May 20 20:29:09.635584 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] For port 93b0417e-99f4-4721-9a41-9257895317c2, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:29:09.651744 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=158c47cc-29b6-4cf6-943a-0acad5faa050,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:09.663809 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:09.666193 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] For port 93b0417e-99f4-4721-9a41-9257895317c2, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=93b0417e-99f4-4721-9a41-9257895317c2,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:29:09.680523 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.685357 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:09.777914 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:09.784211 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:29:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:09.851103 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:09.851327 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e53897c6-5312-4f90-b7ac-8fc3aa8127e4 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:09.871492 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-e0771a58-0d55-40da-b040-7cefccb635e5 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2548168 May 20 20:29:09.887030 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc924bcc-3152-410a-b92c-cc9bbc228554 None None] Pushing event updated for resources: {'Port': ['ID=93b0417e-99f4-4721-9a41-9257895317c2,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:09.902632 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-dc924bcc-3152-410a-b92c-cc9bbc228554 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:10.095533 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:10.099583 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['158c47cc-29b6-4cf6-943a-0acad5faa050'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:29:10.226495 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:10.366586 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-dd6cf754-74ad-41a1-9868-f93c8f65e3c8 service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4941759 May 20 20:29:10.406784 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:10.549211 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-f4759b2b-741e-4126-9d72-6b4377a6129f service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1718516 May 20 20:29:10.550379 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Router d63065d7-57de-4efa-8b36-85f81f815603 is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91646) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:29:10.620941 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d56f9976-dfdc-449f-acdb-eae2ea4a981a None None] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:29:10.758341 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Provisioning for port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:10.769904 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:29:10.786577 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Sync routers for ids ['d63065d7-57de-4efa-8b36-85f81f815603'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:29:10.798268 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Routers {'d63065d7-57de-4efa-8b36-85f81f815603'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:10.800056 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:29:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d63065d7-57de-4efa-8b36-85f81f815603'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:10.801641 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Provisioning complete for port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:10.802137 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:10.838098 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:10.839282 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 4.3814852 May 20 20:29:10.842333 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39306) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:10.975015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf59cde-58d7-410e-add0-3c700a686781 req-5e4003b7-20ff-473f-a097-c11212c086ed tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:10.980199 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-acf59cde-58d7-410e-add0-3c700a686781 req-5e4003b7-20ff-473f-a097-c11212c086ed tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 944 time: 0.1799009 May 20 20:29:11.110599 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-acf59cde-58d7-410e-add0-3c700a686781 req-1ffee509-ae7f-489a-b994-4c9a5583d4f0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242042 May 20 20:29:11.121751 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Set router d63065d7-57de-4efa-8b36-85f81f815603 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:11.186354 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:11.216514 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:09Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:11.229839 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-995f7d82-974c-4996-b97f-16d358458d28 None None] The sync data for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi is: [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:09Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:29:11.243240 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] For port e53897c6-5312-4f90-b7ac-8fc3aa8127e4, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,segment=NetworkSegment(7b4463bd-2158-48b1-8d03-82ca3dc654d2),segment_id=7b4463bd-2158-48b1-8d03-82ca3dc654d2)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:11.265262 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c15846e8-2bf2-44fc-879a-a8070afb0e27 req-bb3644cb-925d-4da9-a190-9d5a6377f769 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 210 time: 0.0795798 May 20 20:29:11.271591 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:11.290670 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-2bbc4965-9033-4c73-9133-40a270fddebf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:11.481392 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Pushing event updated for resources: {'Port': ['ID=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:11.494793 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:11.713870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-49586a37-addf-4c4d-a556-4a9ef57c182b None None] Provisioning complete for port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:11.714364 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49586a37-addf-4c4d-a556-4a9ef57c182b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:11.803027 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:29:08Z', 'revision_number': 3, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port': {'id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:4f:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_gateway', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:07Z', 'updated_at': '2021-05-20T20:29:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:11.804548 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 93b0417e-99f4-4721-9a41-9257895317c2 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:11.807651 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Checking router: d63065d7-57de-4efa-8b36-85f81f815603 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:29:11.808031 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Updating router d63065d7-57de-4efa-8b36-85f81f815603 port fc5c1c51-e5c6-402f-b1fb-66854c51120e binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:29:11.869749 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:11.897786 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 93b0417e-99f4-4721-9a41-9257895317c2 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:11.940362 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 93b0417e-99f4-4721-9a41-9257895317c2 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:11.941014 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.089563 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.124499 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.152644 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 93b0417e-99f4-4721-9a41-9257895317c2, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=93b0417e-99f4-4721-9a41-9257895317c2,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:12.159721 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.160842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e53897c6-5312-4f90-b7ac-8fc3aa8127e4 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:12.194629 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:12.287697 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=93b0417e-99f4-4721-9a41-9257895317c2,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:12.299973 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:12.323407 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.324055 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:12.324509 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.355358 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Transition to ACTIVE for port object fc5c1c51-e5c6-402f-b1fb-66854c51120e will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:12.372549 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.378032 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-d7398d3e-b5da-40dd-b08b-44119fc12078 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:12.397973 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Allocated IP 172.20.0.1 (6821d522-feb4-4c2d-b828-7644a8c51b07/6678003c-d218-460d-b219-200282a61c74/bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:29:12.522165 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb0d9dd3-7f41-4e06-91de-6f3070f992fa None None] Pushing event updated for resources: {'Port': ['ID=fc5c1c51-e5c6-402f-b1fb-66854c51120e,revision_number=2']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:12.532315 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-cb0d9dd3-7f41-4e06-91de-6f3070f992fa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:12.534054 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Attempting to bind port fc5c1c51-e5c6-402f-b1fb-66854c51120e on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:29:12.534611 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Attempting to bind port fc5c1c51-e5c6-402f-b1fb-66854c51120e by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:29:12.535128 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Attempting to bind port fc5c1c51-e5c6-402f-b1fb-66854c51120e on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:12.540968 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 29, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:29:12.541560 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:12.542127 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.542663 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:29:12.543292 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Bound port: fc5c1c51-e5c6-402f-b1fb-66854c51120e, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:29:12.544369 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.567180 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.587689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Transition to ACTIVE for port object bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c will not be triggered until provisioned by entity DHCP. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:12.612055 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.615607 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:12.632787 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] For port fc5c1c51-e5c6-402f-b1fb-66854c51120e, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:29:12.637583 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] For port fc5c1c51-e5c6-402f-b1fb-66854c51120e, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=fc5c1c51-e5c6-402f-b1fb-66854c51120e,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:29:12.642725 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.647262 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-f169b1bd-2c89-4e3c-87d6-537c2b08b945 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:12.685542 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:12.689290 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:12.695150 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:29:12.696234 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.712998 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Pushing event updated for resources: {'Port': ['ID=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:12.726348 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.726981 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.727463 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.727966 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.728565 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.729322 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.730080 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.730933 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.731681 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.732412 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.733118 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.734533 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:12.740370 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:12.763845 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Routers {'d63065d7-57de-4efa-8b36-85f81f815603'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:12.763845 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:29:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d63065d7-57de-4efa-8b36-85f81f815603'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:12.850460 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb0d9dd3-7f41-4e06-91de-6f3070f992fa None None] Pushing event updated for resources: {'Port': ['ID=fc5c1c51-e5c6-402f-b1fb-66854c51120e,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:12.858122 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-cb0d9dd3-7f41-4e06-91de-6f3070f992fa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:12.894642 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:12.970768 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] Set router d63065d7-57de-4efa-8b36-85f81f815603 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:13.036728 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-08f676fc-0775-430c-a711-5f92f703f61a None None] Provisioning for port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:13.041694 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-08f676fc-0775-430c-a711-5f92f703f61a None None] Provisioning complete for port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:13.042145 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-08f676fc-0775-430c-a711-5f92f703f61a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:13.103218 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-08f676fc-0775-430c-a711-5f92f703f61a None None] Port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:29:13.129759 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:13.134530 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:13.135247 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:13.139043 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:13.232547 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Pushing event updated for resources: {'Port': ['ID=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:13.259088 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:29:08Z', 'revision_number': 3, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port': {'id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:4f:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_gateway', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:07Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:13.265771 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac2410da-35ba-4211-a473-d33eb240304c None None] The sync data for ids ['d63065d7-57de-4efa-8b36-85f81f815603'] in dv-cinder-784623-13-iscsi is: [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:29:08Z', 'revision_number': 3, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port': {'id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:4f:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_gateway', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:07Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:29:13.280390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:13.337586 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:13.337586 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:13.572405 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Router d63065d7-57de-4efa-8b36-85f81f815603 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:29:13.646356 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-b3b5599e-2331-4c6e-8501-bb2a39841fe0 None None] Provisioning complete for port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:13.646832 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b3b5599e-2331-4c6e-8501-bb2a39841fe0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:13.737179 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-b3b5599e-2331-4c6e-8501-bb2a39841fe0 None None] Port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:29:13.814807 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 93b0417e-99f4-4721-9a41-9257895317c2 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:13.890161 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 93b0417e-99f4-4721-9a41-9257895317c2 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:13.890530 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:13.909946 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:29:13.929755 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] 10.222.0.82 "PUT /v2.0/routers/d63065d7-57de-4efa-8b36-85f81f815603/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0776191 May 20 20:29:14.061316 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device fc5c1c51-e5c6-402f-b1fb-66854c51120e up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:14.134476 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port fc5c1c51-e5c6-402f-b1fb-66854c51120e completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:14.139872 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port fc5c1c51-e5c6-402f-b1fb-66854c51120e triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:14.140489 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:14.272092 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:14.288798 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port fc5c1c51-e5c6-402f-b1fb-66854c51120e, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=fc5c1c51-e5c6-402f-b1fb-66854c51120e,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:14.293287 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:14.295314 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:14.364173 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=fc5c1c51-e5c6-402f-b1fb-66854c51120e,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:14.367182 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:14.860691 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:14.945917 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Sync routers for ids ['d63065d7-57de-4efa-8b36-85f81f815603'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:29:14.964155 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Routers {'d63065d7-57de-4efa-8b36-85f81f815603'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:14.965334 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:29:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d63065d7-57de-4efa-8b36-85f81f815603'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:15.107043 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d96fd9-3748-4d63-a78c-32f35dd1ee4f req-10a4c48c-944e-43d4-9790-904bbc3c8e7b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:15.113909 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a7d96fd9-3748-4d63-a78c-32f35dd1ee4f req-10a4c48c-944e-43d4-9790-904bbc3c8e7b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 944 time: 0.1417484 May 20 20:29:15.169659 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a7d96fd9-3748-4d63-a78c-32f35dd1ee4f req-506027ce-16b4-46ba-818e-90d4c808100f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468254 May 20 20:29:15.195547 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4d3d0573-3b8a-4b81-b26b-8ff65b68219c req-f2228f19-57dd-4279-b475-f15e7129f852 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 210 time: 0.0670893 May 20 20:29:15.350037 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Set router d63065d7-57de-4efa-8b36-85f81f815603 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:15.748601 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 4, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port': {'id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:4f:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_gateway', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:07Z', 'updated_at': '2021-05-20T20:29:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c', 'name': '', 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'mac_address': 'fa:16:3e:0e:bf:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_interface', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': '6678003c-d218-460d-b219-200282a61c74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:12Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 2, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'subnets': [{'id': '6678003c-d218-460d-b219-200282a61c74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:15.752569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device fc5c1c51-e5c6-402f-b1fb-66854c51120e up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:15.810655 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Checking router: d63065d7-57de-4efa-8b36-85f81f815603 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:29:15.811268 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Updating router d63065d7-57de-4efa-8b36-85f81f815603 port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:29:15.875390 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:16.036337 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port fc5c1c51-e5c6-402f-b1fb-66854c51120e triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:16.036719 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:16.540992 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36fe48d-b694-48e7-ac50-d4e88848a3ef req-28514a0d-6fe5-485a-946a-03e2dd9fda8d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:16.545423 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c36fe48d-b694-48e7-ac50-d4e88848a3ef req-28514a0d-6fe5-485a-946a-03e2dd9fda8d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 944 time: 0.1918674 May 20 20:29:16.577238 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:16.593666 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Transition to ACTIVE for port object bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:16.610611 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:16.618426 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:16.667102 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c36fe48d-b694-48e7-ac50-d4e88848a3ef req-e038aa91-89cd-4952-9569-d6f4da8304b2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1100359 May 20 20:29:16.797105 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:29:16.826185 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-f89c0ce7-aa3b-4371-b386-85e7ab05978e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:16.827859 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-f89c0ce7-aa3b-4371-b386-85e7ab05978e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 0.5678093 May 20 20:29:16.853696 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 158c47cc-29b6-4cf6-943a-0acad5faa050 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:16.881641 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Request body: {'port': {'device_id': '6b601b12-a621-4606-99b1-c22f99edbcce', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'admin_state_up': True, 'tenant_id': '6eec95c790c84cfc8a6a2fbd90bb926c'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:16.913125 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-72df2fb3-ba29-4689-bee0-242782613d97 req-6bcbfbb7-10de-4f74-9bc1-0e7d07442f16 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 210 time: 0.5148714 May 20 20:29:17.070323 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b64cad-1191-4abf-8b55-a3b8afa5a03d None None] Pushing event updated for resources: {'Port': ['ID=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:17.090540 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c5b64cad-1191-4abf-8b55-a3b8afa5a03d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.463s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:17.135477 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:17.147182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:17.153008 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Attempting to bind port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:29:17.153414 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Attempting to bind port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:29:17.153775 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Attempting to bind port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c on network 6821d522-feb4-4c2d-b828-7644a8c51b07 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:17.163520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Made reservation on behalf of 6eec95c790c84cfc8a6a2fbd90bb926c for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:29:17.166044 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 29, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:29:17.168155 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Checking segment: {'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:17.168926 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:17.169422 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:17.169551 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Bound using segment: {'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:29:17.170003 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Bound port: bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7b4463bd-2158-48b1-8d03-82ca3dc654d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:29:17.170403 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:17.331380 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 158c47cc-29b6-4cf6-943a-0acad5faa050 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:17.354814 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] For port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:29:17.358834 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] For port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,segment=NetworkSegment(7b4463bd-2158-48b1-8d03-82ca3dc654d2),segment_id=7b4463bd-2158-48b1-8d03-82ca3dc654d2)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:29:17.378376 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 158c47cc-29b6-4cf6-943a-0acad5faa050 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:17.378756 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:17.474887 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:17.515997 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-5b30dc75-56bc-4ace-a9b4-c9798c3ecb83 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:17.553195 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Allocated IP 172.20.0.14 (2021d324-55d7-4959-b1a9-ee3e58b34538/8debe367-8908-48d3-a2e2-6afb3c3cda2a/90dacfdb-310f-446a-a389-3184996fd51e) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:29:17.675494 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b64cad-1191-4abf-8b55-a3b8afa5a03d None None] Pushing event updated for resources: {'Port': ['ID=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:17.691640 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c5b64cad-1191-4abf-8b55-a3b8afa5a03d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:17.763082 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Routers {'d63065d7-57de-4efa-8b36-85f81f815603'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:29:17.764131 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:29:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d63065d7-57de-4efa-8b36-85f81f815603'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:17.930771 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:17.968632 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a99038-0523-4290-b5ad-d481c5c545f3 req-f9019a54-1965-4852-bad0-5893d86d1677 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:17.978275 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-14a99038-0523-4290-b5ad-d481c5c545f3 req-f9019a54-1965-4852-bad0-5893d86d1677 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 944 time: 0.1487899 May 20 20:29:18.016947 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:18.042547 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:18.051914 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] Set router d63065d7-57de-4efa-8b36-85f81f815603 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:29:18.057120 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-14a99038-0523-4290-b5ad-d481c5c545f3 req-67fc0b1c-a5a8-4ccf-9f05-1b0af0cede8b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762613 May 20 20:29:18.153756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:18.161716 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:18.175074 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:29:18.239874 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4', '08f701b8-1580-4323-b2f2-c088e14e4e28'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:29:18.310468 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event updated for resources: {'Port': ['ID=90dacfdb-310f-446a-a389-3184996fd51e,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:18.340503 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.342949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.342949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.342949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.342949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.342949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.343411 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.343950 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.344426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.345025 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.346279 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.346802 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:18.354563 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.312s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:18.383159 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:18.384063 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:18.413969 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30059339-c6a3-4e46-bf72-71faa12f7d71 req-971dab80-c83d-44c7-8eec-91ac2918bfcb tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:18.415977 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-30059339-c6a3-4e46-bf72-71faa12f7d71 req-971dab80-c83d-44c7-8eec-91ac2918bfcb tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 932 time: 0.1947834 May 20 20:29:18.483474 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-30059339-c6a3-4e46-bf72-71faa12f7d71 req-bd851619-fa84-4c79-8394-9108854a2bfd tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556297 May 20 20:29:18.485288 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6084185 May 20 20:29:18.506932 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Request body: {'port': {'device_id': '6b601b12-a621-4606-99b1-c22f99edbcce', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:18.691033 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:18.695275 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:18.752007 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a719272-e929-4463-9b07-480500fcb622', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '158c47cc-29b6-4cf6-943a-0acad5faa050'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:29:18.792370 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 158c47cc-29b6-4cf6-943a-0acad5faa050, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=158c47cc-29b6-4cf6-943a-0acad5faa050,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:18.876599 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:18.880932 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:18.957377 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 4, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port': {'id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:4f:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_gateway', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:07Z', 'updated_at': '2021-05-20T20:29:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c', 'name': '', 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'mac_address': 'fa:16:3e:0e:bf:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_interface', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': '6678003c-d218-460d-b219-200282a61c74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:12Z', 'updated_at': '2021-05-20T20:29:17Z', 'revision_number': 4, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'subnets': [{'id': '6678003c-d218-460d-b219-200282a61c74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:29:19.008315 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f15fda4-2381-48ca-80c9-c89e3e10164d None None] The sync data for ids ['d63065d7-57de-4efa-8b36-85f81f815603'] in dv-cinder-784623-13-iscsi is: [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 4, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port': {'id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:4f:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_gateway', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:07Z', 'updated_at': '2021-05-20T20:29:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c', 'name': '', 'network_id': '6821d522-feb4-4c2d-b828-7644a8c51b07', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'mac_address': 'fa:16:3e:0e:bf:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_interface', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': '6678003c-d218-460d-b219-200282a61c74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:12Z', 'updated_at': '2021-05-20T20:29:17Z', 'revision_number': 4, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'subnets': [{'id': '6678003c-d218-460d-b219-200282a61c74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:29:19.050816 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a719272-e929-4463-9b07-480500fcb622', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '158c47cc-29b6-4cf6-943a-0acad5faa050', 'code': 200} May 20 20:29:19.055695 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=158c47cc-29b6-4cf6-943a-0acad5faa050,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:19.060207 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:19.612152 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 90dacfdb-310f-446a-a389-3184996fd51e {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:29:19.655148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:19.697559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Transition to ACTIVE for port object 90dacfdb-310f-446a-a389-3184996fd51e will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:19.707957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a9edb3d-bfb2-444f-873a-134a046653d5 req-be3b052d-6b17-45cf-8b32-7b78a8329e8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:19.709825 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6a9edb3d-bfb2-444f-873a-134a046653d5 req-be3b052d-6b17-45cf-8b32-7b78a8329e8f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 1098 time: 0.2120872 May 20 20:29:19.737350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:19.762450 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c2e58298-e1eb-4c5e-849f-347ce865c093 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:19.843301 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:19.979171 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dac5ff1-bf3c-4ae1-9f6a-271a369b84e6 req-86c72406-b9f8-444b-9ed5-b8ccb34ec887 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:19.986991 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2dac5ff1-bf3c-4ae1-9f6a-271a369b84e6 req-86c72406-b9f8-444b-9ed5-b8ccb34ec887 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 944 time: 0.2166171 May 20 20:29:20.037036 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:20.043065 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:20.044340 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:20.066463 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2dac5ff1-bf3c-4ae1-9f6a-271a369b84e6 req-0f60520b-eb74-47e1-8c72-1d0a3bf4ae5c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782611 May 20 20:29:20.216124 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Pushing event updated for resources: {'Port': ['ID=90dacfdb-310f-446a-a389-3184996fd51e,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:20.236441 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68fdfd68-d051-4257-907d-62d77ce0fba2 req-043c9ab4-b525-49e9-80fb-6b016b483c92 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:20.238072 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68fdfd68-d051-4257-907d-62d77ce0fba2 req-043c9ab4-b525-49e9-80fb-6b016b483c92 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.8255057 May 20 20:29:20.248577 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.486s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:20.335558 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6a9edb3d-bfb2-444f-873a-134a046653d5 req-e0f4665d-bc6a-4c66-8841-40f960ca9c78 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5784359 May 20 20:29:20.384226 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:20.433063 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,segment=NetworkSegment(7b4463bd-2158-48b1-8d03-82ca3dc654d2),segment_id=7b4463bd-2158-48b1-8d03-82ca3dc654d2)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:20.450689 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:20.461322 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-dc924bcc-3152-410a-b92c-cc9bbc228554 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:20.472539 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68fdfd68-d051-4257-907d-62d77ce0fba2 req-2f963bb2-ec48-46ca-bcc2-3660f4d1fb98 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2095726 May 20 20:29:20.513727 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Attempting to bind port 90dacfdb-310f-446a-a389-3184996fd51e on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:29:20.514048 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Attempting to bind port 90dacfdb-310f-446a-a389-3184996fd51e by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:29:20.514368 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Attempting to bind port 90dacfdb-310f-446a-a389-3184996fd51e on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:20.523715 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Port 90dacfdb-310f-446a-a389-3184996fd51e on network 2021d324-55d7-4959-b1a9-ee3e58b34538 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:29:20.524063 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Attempting to bind port 90dacfdb-310f-446a-a389-3184996fd51e on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:20.547898 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 29, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:29:20.547898 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Checking segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:20.547898 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Bound using segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:29:20.547898 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Bound port: 90dacfdb-310f-446a-a389-3184996fd51e, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:29:20.547898 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:20.592873 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:20.603613 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:20.681756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] For port 90dacfdb-310f-446a-a389-3184996fd51e, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:29:20.685363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] For port 90dacfdb-310f-446a-a389-3184996fd51e, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=90dacfdb-310f-446a-a389-3184996fd51e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:29:20.692445 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:20.698327 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bcc7bbff-30ab-4141-9698-a7f4898d191f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:20.771834 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:20.772715 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:20.774171 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] 10.222.0.69 "PUT /v2.0/ports/90dacfdb-310f-446a-a389-3184996fd51e HTTP/1.1" status: 200 len: 1094 time: 2.2729428 May 20 20:29:20.774722 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b601b12-a621-4606-99b1-c22f99edbcce', 'tag': '90dacfdb-310f-446a-a389-3184996fd51e'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:29:20.809680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Pushing event updated for resources: {'Port': ['ID=90dacfdb-310f-446a-a389-3184996fd51e,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:20.813037 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:20.877837 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b601b12-a621-4606-99b1-c22f99edbcce', 'tag': '90dacfdb-310f-446a-a389-3184996fd51e', 'status': 'completed', 'code': 200} May 20 20:29:20.943929 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-e61e0bab-a9f2-49a0-928c-2dada45c43b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:20.945282 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-e61e0bab-a9f2-49a0-928c-2dada45c43b7 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 1097 time: 0.1047685 May 20 20:29:21.048189 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-23b47036-6fcf-4916-9334-a439a750516c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=90dacfdb-310f-446a-a389-3184996fd51e HTTP/1.1" status: 200 len: 217 time: 0.0838563 May 20 20:29:21.154743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-da9b06d1-f3fd-4868-88cd-a5fff6a78e12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:21.156464 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-da9b06d1-f3fd-4868-88cd-a5fff6a78e12 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.0868001 May 20 20:29:21.233530 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-b6998535-6673-4e74-b727-591bf04cb423 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0650108 May 20 20:29:21.321681 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2aa17da-2156-48fe-9175-8eb97930566b req-1020ac5d-d795-4d9c-9d95-93a01924b734 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:21.329261 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e2aa17da-2156-48fe-9175-8eb97930566b req-1020ac5d-d795-4d9c-9d95-93a01924b734 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 944 time: 0.1371891 May 20 20:29:21.394811 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e2aa17da-2156-48fe-9175-8eb97930566b req-7cc9cffa-cc97-4bb1-bbaa-c538ee7057b9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0635855 May 20 20:29:21.445866 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-eeb5b70e-1a3c-4ef0-84f3-2c8dc0488a1f service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1928494 May 20 20:29:21.722549 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff4d8433-ddb2-45e3-b79d-1814e50452fa req-089d4e28-9f39-470d-a78d-1472af8ca011 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2551546 May 20 20:29:21.790243 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:21.886445 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:21.886994 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:21.975283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-30bca44a-4861-411b-9bee-777840267bf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:21.979066 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-30bca44a-4861-411b-9bee-777840267bf2 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 1097 time: 0.1591268 May 20 20:29:21.996878 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39496) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:22.162045 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503651e1-da65-4d91-a516-b85d1fe916e0 req-dfee41f5-275e-4f9e-934b-e74460b4577e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:22.164472 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-503651e1-da65-4d91-a516-b85d1fe916e0 req-dfee41f5-275e-4f9e-934b-e74460b4577e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1703098 May 20 20:29:22.285922 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-503651e1-da65-4d91-a516-b85d1fe916e0 req-08480b5a-d3f8-4d99-8185-aff781078de1 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148882 May 20 20:29:22.326098 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:22.353246 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:22.357695 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Usage tracker for resource:security_group_rule and tenant:4848a5ad80854d5b9040846302e2077a is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:22.360300 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:22.367186 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:22.389720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-a1149b33-b2a9-456d-83ae-374a4ece8140 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:22.394231 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-a1149b33-b2a9-456d-83ae-374a4ece8140 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 916 time: 0.3839099 May 20 20:29:22.464146 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:22.468714 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:22.498503 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:22.515638 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-90f6aa48-b4f9-42ce-a5cc-c0189e650d97 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=90dacfdb-310f-446a-a389-3184996fd51e HTTP/1.1" status: 200 len: 217 time: 0.1042550 May 20 20:29:22.565904 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4848a5ad80854d5b9040846302e2077a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5674827 May 20 20:29:22.568732 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=452a2606-835d-4af5-85ba-70d03fac3ec0,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:22.574672 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39514) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:22.581678 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:22.700581 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:22.709107 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-b3e704eb-a09c-4eff-9471-ceeae8322796 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:22.711154 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-b3e704eb-a09c-4eff-9471-ceeae8322796 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.1798961 May 20 20:29:22.738169 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:22.745812 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6d075a-d24d-44e8-b3ac-331cb9116404 req-88fee573-6800-4f1e-8115-9a035fb39637 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:22.750448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-db6d075a-d24d-44e8-b3ac-331cb9116404 req-88fee573-6800-4f1e-8115-9a035fb39637 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:29:22.790213 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39522) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:22.831817 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:22.838602 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9b247ecc-75f1-4007-beb9-41945bdeaf01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:22.841879 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-c9432858-0e38-4579-b070-13b1064124f1 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0874293 May 20 20:29:22.858367 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=452a2606-835d-4af5-85ba-70d03fac3ec0,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:22.869138 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:22.875546 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:22.877125 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/452a2606-835d-4af5-85ba-70d03fac3ec0 HTTP/1.1" status: 204 len: 168 time: 0.3002911 May 20 20:29:22.911325 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-db6d075a-d24d-44e8-b3ac-331cb9116404 req-88fee573-6800-4f1e-8115-9a035fb39637 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:29:22.918768 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-db6d075a-d24d-44e8-b3ac-331cb9116404 req-88fee573-6800-4f1e-8115-9a035fb39637 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 944 time: 0.3047535 May 20 20:29:22.998483 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-db6d075a-d24d-44e8-b3ac-331cb9116404 req-12a9f350-4c80-47de-bab4-c6aa8c597ecd tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785489 May 20 20:29:23.051263 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.090473 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:23.095945 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Usage tracker for resource:security_group_rule and tenant:e92a59a446eb4fa2bbb02ab1f4fbe28e is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:23.099720 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:23.106805 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:23.118896 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-54b03961-1484-48de-a162-0662cd88bbbc service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2395380 May 20 20:29:23.234952 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.242462 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.262726 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-55a4c806-9f69-4294-a49c-6f147ad8f1fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:23.333756 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e92a59a446eb4fa2bbb02ab1f4fbe28e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5425124 May 20 20:29:23.338727 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39538) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:23.421842 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=388a7e13-bfab-4a67-9798-1962917c4c98,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:23.430052 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:23.481508 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3b0b5f5c-c68f-48ad-bfa0-904c482b9adc req-b2ecb9e1-4188-4dca-a5c4-6d4b4109fc8c service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3471534 May 20 20:29:23.489551 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.528677 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39542) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:23.549968 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.567906 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:23.571728 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.573250 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Usage tracker for resource:security_group_rule and tenant:5270d1fc65cd4f55adf6938113a0f97c is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:23.576668 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:23.585279 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:23.655082 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd603d5-3936-49dc-967a-783023c34f01 req-74133d02-64c2-411f-a41a-2c63f48a4c10 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:23.656636 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dbd603d5-3936-49dc-967a-783023c34f01 req-74133d02-64c2-411f-a41a-2c63f48a4c10 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1500399 May 20 20:29:23.710011 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.717569 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.717871 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:23.723145 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.733208 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=388a7e13-bfab-4a67-9798-1962917c4c98,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:23.733816 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:23.735177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ca917be1-261e-4695-8c19-938e6aad422a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:23.757063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.760768 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/388a7e13-bfab-4a67-9798-1962917c4c98 HTTP/1.1" status: 204 len: 168 time: 0.4142487 May 20 20:29:23.781685 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=091e796c-949a-4ec1-ae98-dbaf33038ac9,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:23.788141 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:23.789358 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dbd603d5-3936-49dc-967a-783023c34f01 req-31b5150c-b99a-4ec2-8d90-93b3887a9645 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099865 May 20 20:29:23.824118 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5270d1fc65cd4f55adf6938113a0f97c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2941065 May 20 20:29:23.826645 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39556) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:23.945151 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1a967936-e9bf-46a0-ba73-fab9decb8317 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:23.975555 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1a967936-e9bf-46a0-ba73-fab9decb8317 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:24.055522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1a967936-e9bf-46a0-ba73-fab9decb8317 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:24.061281 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7458bcc9-9ffc-4a4c-8178-ae9052a0930f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:24.095693 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1a967936-e9bf-46a0-ba73-fab9decb8317 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:24.099101 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-1a967936-e9bf-46a0-ba73-fab9decb8317 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/091e796c-949a-4ec1-ae98-dbaf33038ac9 HTTP/1.1" status: 204 len: 168 time: 0.2691402 May 20 20:29:24.099101 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a967936-e9bf-46a0-ba73-fab9decb8317 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=091e796c-949a-4ec1-ae98-dbaf33038ac9,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:24.100940 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-1a967936-e9bf-46a0-ba73-fab9decb8317 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:24.372928 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43279419-97e2-4e5d-86a4-dd9848017c98 req-f400af9b-a6c3-4395-9647-31b51fc4dbb8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:24.387807 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-43279419-97e2-4e5d-86a4-dd9848017c98 req-f400af9b-a6c3-4395-9647-31b51fc4dbb8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 944 time: 0.1445661 May 20 20:29:24.493012 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-43279419-97e2-4e5d-86a4-dd9848017c98 req-904b322c-8608-4412-b327-70d0caec4838 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039126 May 20 20:29:24.525059 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-39871090-301f-4167-b38d-d7b9dea7fde8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:24.526852 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-39871090-301f-4167-b38d-d7b9dea7fde8 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 1098 time: 0.2471254 May 20 20:29:24.591267 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76065301-2b95-40f6-a8b3-48e4286fb354 req-70092c2c-5e5b-46cb-b798-4db9914b850f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:24.600367 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-76065301-2b95-40f6-a8b3-48e4286fb354 req-70092c2c-5e5b-46cb-b798-4db9914b850f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1656682 May 20 20:29:24.741672 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-76065301-2b95-40f6-a8b3-48e4286fb354 req-2030743d-0066-4cfa-b759-3454a8cfca8e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1399813 May 20 20:29:24.789031 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-b48454ba-b5bb-4d55-8bae-3cf45abc0f96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:24.791171 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-b48454ba-b5bb-4d55-8bae-3cf45abc0f96 service neutron] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 919 time: 0.2343717 May 20 20:29:24.853945 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39590) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:24.871964 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:24.884118 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-a65e9bea-84fa-4ec2-b283-83ed9a5d10d8 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=158c47cc-29b6-4cf6-943a-0acad5faa050 HTTP/1.1" status: 200 len: 217 time: 0.0787342 May 20 20:29:24.896755 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:24.909409 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Usage tracker for resource:security_group_rule and tenant:d621e845ed324c75b5780265f7027276 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:24.912776 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:24.922454 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:24.975653 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-447b0657-b929-480b-8534-1094cca6abb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:24.977736 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-447b0657-b929-480b-8534-1094cca6abb2 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.0816441 May 20 20:29:25.049339 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:25.049873 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-cb46b122-5b55-484b-852f-b8b093b17011 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0525162 May 20 20:29:25.054177 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:25.063515 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c8e6d7a5-78db-49a2-ba32-17f7eaadd79a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:25.109265 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d621e845ed324c75b5780265f7027276&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2542856 May 20 20:29:25.111155 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39602) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:25.113752 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9a6be4b-7719-4765-a157-a6f2bb8b3b0e,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:25.132577 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:25.210366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:25.249899 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:25.343538 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-2292b101-d1b1-4b88-8a99-f333b672eb60 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2724924 May 20 20:29:25.349020 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:25.358690 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0a07e205-9bff-416f-b4a5-d0a6079812b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:25.370216 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9a6be4b-7719-4765-a157-a6f2bb8b3b0e,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:25.373476 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:25.381138 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:25.393727 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a9a6be4b-7719-4765-a157-a6f2bb8b3b0e HTTP/1.1" status: 204 len: 168 time: 0.2730114 May 20 20:29:25.581837 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bc735df-2f45-4e02-8660-d815986c5c17 req-a82889f0-9d8d-4889-928c-edaec7d967cb service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2112145 May 20 20:29:25.784442 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4612d692-f571-4387-a535-db7e1408c920 req-06cced4c-a145-4518-9589-20e5eed32b49 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:25.784442 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4612d692-f571-4387-a535-db7e1408c920 req-06cced4c-a145-4518-9589-20e5eed32b49 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 944 time: 0.1189103 May 20 20:29:25.924535 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4612d692-f571-4387-a535-db7e1408c920 req-9215e8b4-32a7-40fd-93a3-856eb9bb9ced tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1343756 May 20 20:29:26.101445 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e498525b-ceb5-4b7d-84e9-9aeeea72c345 req-71a66112-968d-4662-afc1-4816697f4892 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:26.103055 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e498525b-ceb5-4b7d-84e9-9aeeea72c345 req-71a66112-968d-4662-afc1-4816697f4892 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1758311 May 20 20:29:26.246454 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e498525b-ceb5-4b7d-84e9-9aeeea72c345 req-72ee0881-6426-418b-8cc9-8a36377878c4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1032507 May 20 20:29:26.887829 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 90dacfdb-310f-446a-a389-3184996fd51e details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:29:27.058692 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 90dacfdb-310f-446a-a389-3184996fd51e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=90dacfdb-310f-446a-a389-3184996fd51e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:27.075713 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '90dacfdb-310f-446a-a389-3184996fd51e', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'port_id': '90dacfdb-310f-446a-a389-3184996fd51e', 'mac_address': 'fa:16:3e:c4:f9:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8debe367-8908-48d3-a2e2-6afb3c3cda2a', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:29:27.179562 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:27.219532 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 90dacfdb-310f-446a-a389-3184996fd51e {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:29:27.220993 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a01c3eb-6d5e-4c4c-ab05-0a4c6c5d71d7 req-56c3c275-3109-4b95-8c90-f559679eea7b tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:27.229589 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a01c3eb-6d5e-4c4c-ab05-0a4c6c5d71d7 req-56c3c275-3109-4b95-8c90-f559679eea7b tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 944 time: 0.1165078 May 20 20:29:27.253989 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 90dacfdb-310f-446a-a389-3184996fd51e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=90dacfdb-310f-446a-a389-3184996fd51e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:27.261430 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:27.266044 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:27.291850 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a01c3eb-6d5e-4c4c-ab05-0a4c6c5d71d7 req-cce5ea49-1403-4f45-851a-dea69c70ccc8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612054 May 20 20:29:27.356297 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=90dacfdb-310f-446a-a389-3184996fd51e,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:27.365910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.366324 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.366756 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.367322 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.367546 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.367933 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.368499 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.368617 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.368918 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.369185 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.369695 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.370073 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:29:27.382698 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:27.495749 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c193b3d-e240-4dd6-9d82-3f7181685443 req-ad8d74c8-2b71-42d6-b7b9-db4ef319b89c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:27.498062 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1c193b3d-e240-4dd6-9d82-3f7181685443 req-ad8d74c8-2b71-42d6-b7b9-db4ef319b89c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0958598 May 20 20:29:27.531987 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39670) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:27.565400 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1c193b3d-e240-4dd6-9d82-3f7181685443 req-b7769e97-6130-413f-bd90-b7909b86ab5c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605474 May 20 20:29:27.676932 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:27.692999 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:27.697039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Usage tracker for resource:security_group_rule and tenant:04daaa8872294fb8bb616cce76e4db0a is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:27.700067 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:27.708794 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:27.820440 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:27.829792 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:27.860136 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7b7afec2-6831-44a9-bd99-39101721c8b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:27.896797 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f0d1a64-0ddd-458a-8ab2-5ccfd8d2ee26,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:27.900707 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:27.903229 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=04daaa8872294fb8bb616cce76e4db0a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3689775 May 20 20:29:27.905817 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39686) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:27.919501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['90dacfdb-310f-446a-a389-3184996fd51e'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:29:27.982546 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:28.025132 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:28.135606 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:28.139706 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6fb86923-dd4a-4631-92da-83a14624916b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:28.153311 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f0d1a64-0ddd-458a-8ab2-5ccfd8d2ee26,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:28.163780 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:28.166367 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:28.176509 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7f0d1a64-0ddd-458a-8ab2-5ccfd8d2ee26 HTTP/1.1" status: 204 len: 168 time: 0.2692347 May 20 20:29:28.505355 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cba8d7-c865-4074-aa6b-9ec709214070 req-559b310f-518c-4683-b2ce-7bc4e19bc32e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:28.512382 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e4cba8d7-c865-4074-aa6b-9ec709214070 req-559b310f-518c-4683-b2ce-7bc4e19bc32e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 945 time: 0.1056361 May 20 20:29:28.658162 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e4cba8d7-c865-4074-aa6b-9ec709214070 req-5e81075f-9b7e-428e-b62c-4f4b22ea72d4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440630 May 20 20:29:28.795676 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99025e0b-a6d6-4e65-ab06-53fcc52410e4 req-fb276d29-8791-4979-96d5-f101c12aed5f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:28.804007 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-99025e0b-a6d6-4e65-ab06-53fcc52410e4 req-fb276d29-8791-4979-96d5-f101c12aed5f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0953670 May 20 20:29:28.879221 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-99025e0b-a6d6-4e65-ab06-53fcc52410e4 req-9d067284-2eac-484f-b89f-41f31c706ce9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743468 May 20 20:29:29.759450 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 39716) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:29.892716 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6187e38-b368-47b2-97ef-d4e68db12245 req-bae5aeb5-08e5-45a5-a68a-50f2fc099f3c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:29.895250 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f6187e38-b368-47b2-97ef-d4e68db12245 req-bae5aeb5-08e5-45a5-a68a-50f2fc099f3c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 945 time: 0.0947824 May 20 20:29:29.938366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:29.972753 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:29.980799 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Usage tracker for resource:security_group_rule and tenant:d7abf04e3d034c71be388df1f9350849 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:29:29.994105 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f6187e38-b368-47b2-97ef-d4e68db12245 req-60b44663-47d3-4cf6-8519-6c6a6929e113 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915864 May 20 20:29:30.009148 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:29:30.013361 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:30.138592 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:30.148684 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:30.158888 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-12b40b4b-d496-4cce-9d6d-cb0da696656c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:30.159327 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941ad6b0-7de4-4d21-8a36-bc59c1fde275 req-c2f9eb5f-60b2-4b9e-b8b9-82dbe7378bc9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:30.161514 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-941ad6b0-7de4-4d21-8a36-bc59c1fde275 req-c2f9eb5f-60b2-4b9e-b8b9-82dbe7378bc9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1381168 May 20 20:29:30.212316 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d7abf04e3d034c71be388df1f9350849&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4512339 May 20 20:29:30.212933 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2abb5e6a-0670-4904-a177-484aa4989d84,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:30.214676 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 39730) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:29:30.216168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:30.245980 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-941ad6b0-7de4-4d21-8a36-bc59c1fde275 req-9c4ce3ef-9d8b-49d9-b038-33474a0d59ea tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787151 May 20 20:29:30.352121 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:30.388933 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:30.473767 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:30.482520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-82feb5db-daca-4f63-84bd-a3c6d5f860dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:30.499522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2abb5e6a-0670-4904-a177-484aa4989d84,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:30.503977 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:30.508314 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:30.509632 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2abb5e6a-0670-4904-a177-484aa4989d84 HTTP/1.1" status: 204 len: 168 time: 0.2938187 May 20 20:29:30.620306 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-5ac3d15b-7b9e-4281-ac05-f496b3d21740 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Synchronizing usage tracker for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:29:30.644954 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-5ac3d15b-7b9e-4281-ac05-f496b3d21740 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Unset dirty status for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:29:30.646419 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-5ac3d15b-7b9e-4281-ac05-f496b3d21740 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1266536510&fields=id&tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238 HTTP/1.1" status: 200 len: 267 time: 0.0824444 May 20 20:29:30.819152 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b879e79b-e9e4-485a-ad19-55a06a541ff3 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:30.819884 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b879e79b-e9e4-485a-ad19-55a06a541ff3 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Synchronizing usage tracker for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:network {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:29:30.837725 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b879e79b-e9e4-485a-ad19-55a06a541ff3 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Unset dirty status for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:network {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:29:30.838874 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b879e79b-e9e4-485a-ad19-55a06a541ff3 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 808 time: 0.1856136 May 20 20:29:30.854003 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-5992ddfb-9753-4c17-bcce-22a09a3a0d85 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/quotas/bf9ff50b3c4f4f7e8afcf9c87cade238 HTTP/1.1" status: 200 len: 375 time: 0.0092661 May 20 20:29:30.931875 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 90dacfdb-310f-446a-a389-3184996fd51e up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:29:30.952719 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-4f26cb2d-3594-4a3c-a028-49641e3718ad tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Synchronizing usage tracker for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:29:30.970872 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-4f26cb2d-3594-4a3c-a028-49641e3718ad tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Unset dirty status for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:29:30.972197 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-4f26cb2d-3594-4a3c-a028-49641e3718ad tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1129684 May 20 20:29:31.021576 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 90dacfdb-310f-446a-a389-3184996fd51e completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:31.029115 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 90dacfdb-310f-446a-a389-3184996fd51e triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:31.030424 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:31.144441 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-cb35514d-22aa-422e-bdd4-90dd1eac292c service neutron] 10.222.0.82 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1545672 May 20 20:29:31.163447 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:31.196619 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b601b12-a621-4606-99b1-c22f99edbcce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90dacfdb-310f-446a-a389-3184996fd51e'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:29:31.213372 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 90dacfdb-310f-446a-a389-3184996fd51e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=90dacfdb-310f-446a-a389-3184996fd51e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:29:31.219422 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:31.224237 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:31.297605 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-cec46e75-be3c-4acb-8c2d-5c114990660b service neutron] 10.222.0.82 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1465585 May 20 20:29:31.309911 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=90dacfdb-310f-446a-a389-3184996fd51e,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:31.313259 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:31.721056 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b601b12-a621-4606-99b1-c22f99edbcce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90dacfdb-310f-446a-a389-3184996fd51e', 'code': 200} May 20 20:29:31.860044 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20f63fe-200c-447c-9ced-51eb9b032822 req-1391550a-86b1-4133-9470-b7d029899759 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:31.870171 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f20f63fe-200c-447c-9ced-51eb9b032822 req-1391550a-86b1-4133-9470-b7d029899759 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.1323736 May 20 20:29:31.927208 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f20f63fe-200c-447c-9ced-51eb9b032822 req-4efe5cae-6b0e-47db-bf00-181a8715949c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508919 May 20 20:29:32.148209 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a59d0e7-b0bc-47c8-aaeb-0363dcfe5330 req-88175f2f-81da-45d9-b3d4-07c2c8585bda tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:32.156934 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7a59d0e7-b0bc-47c8-aaeb-0363dcfe5330 req-88175f2f-81da-45d9-b3d4-07c2c8585bda tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1019990 May 20 20:29:32.201692 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7a59d0e7-b0bc-47c8-aaeb-0363dcfe5330 req-3a14007e-fe51-420d-927b-045b493c2aa6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429807 May 20 20:29:32.250135 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8ffab0-119b-4722-b585-f86b850b44c7 req-2c20cce2-3e85-419b-a3b5-1a392b6eb1f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:32.252354 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bd8ffab0-119b-4722-b585-f86b850b44c7 req-2c20cce2-3e85-419b-a3b5-1a392b6eb1f1 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 1099 time: 0.2245545 May 20 20:29:32.345197 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bd8ffab0-119b-4722-b585-f86b850b44c7 req-91059b3f-d18c-4347-bab8-8ed77f921e32 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447447 May 20 20:29:32.362467 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d4181d35-87a3-4be2-9c75-205d97da12f2 req-6a11f2e3-6865-42bd-86de-01a5575d2d3c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 210 time: 0.0497153 May 20 20:29:32.500710 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-8298b90a-08b8-4056-995b-ada020945f9e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:32.502350 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-8298b90a-08b8-4056-995b-ada020945f9e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 814 time: 0.1478202 May 20 20:29:32.516717 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-b68da44e-8486-4ea0-8459-4dac6039821a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/quotas/7c0b04802f8b42819b613e195b66efb7 HTTP/1.1" status: 200 len: 375 time: 0.0089939 May 20 20:29:32.605769 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-dad64a4d-01ad-4f24-a79b-36715abe850a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0832732 May 20 20:29:32.747660 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-f26cc036-68c1-4918-8d9c-5c0420a1f38f service neutron] 10.222.0.82 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1295636 May 20 20:29:32.876960 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-730f864b-4802-4798-bece-918b4dbe9c29 service neutron] 10.222.0.82 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1226075 May 20 20:29:33.133261 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9359fd63-026c-4274-9349-682f28dee7fb req-53db669c-64de-42c2-8a07-1e5618c11b58 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:33.134628 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9359fd63-026c-4274-9349-682f28dee7fb req-53db669c-64de-42c2-8a07-1e5618c11b58 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0877998 May 20 20:29:33.181727 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9359fd63-026c-4274-9349-682f28dee7fb req-c2761813-b763-41a7-8ae5-f486d1553895 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414891 May 20 20:29:33.249931 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7033a707-6805-4293-abd2-c1e387782bdb req-e8b5c2c9-5504-4374-8dc0-dfd0c47dcd4b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.0439358 May 20 20:29:33.448800 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1187893-170a-4ebd-b7f3-f9905361f2e7 req-60ce05f4-9bdf-462d-a691-dd175f27706d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:33.452268 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1187893-170a-4ebd-b7f3-f9905361f2e7 req-60ce05f4-9bdf-462d-a691-dd175f27706d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1108325 May 20 20:29:33.505408 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1187893-170a-4ebd-b7f3-f9905361f2e7 req-20b03872-6912-4d57-ab5f-e332d93aeecc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488756 May 20 20:29:33.651027 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8fac764f-17a1-483a-8fc4-25508823c979 req-6328969b-ce57-4035-8423-73d9bea367b0 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 210 time: 0.0887487 May 20 20:29:33.785906 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-c5f6aff2-cb52-4f1e-ae01-b81f92275ccb tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:33.787225 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-c5f6aff2-cb52-4f1e-ae01-b81f92275ccb tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.69 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 808 time: 0.2263186 May 20 20:29:33.908829 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b59ae750-d0e4-48e0-90c3-333cfc641ece tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Synchronizing usage tracker for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:29:33.922394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b59ae750-d0e4-48e0-90c3-333cfc641ece tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Unset dirty status for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:29:33.924167 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b59ae750-d0e4-48e0-90c3-333cfc641ece tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238 HTTP/1.1" status: 200 len: 380 time: 0.0579467 May 20 20:29:33.953118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'port': {'device_id': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'admin_state_up': True, 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'security_groups': ['5ec7237a-3e86-4e4b-b272-c39dc89160c5']}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:34.091952 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:34.103362 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:34.113275 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Made reservation on behalf of bf9ff50b3c4f4f7e8afcf9c87cade238 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:29:34.116928 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:34.287741 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Allocated IP 172.20.0.5 (9c4884cd-a197-48ab-a497-3c07afe55035/845e6d5e-4ee4-43a5-a910-0fd3f1657178/8901084c-f60b-4b41-82bc-2d359b04000f) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:29:34.524472 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db1658a-f106-4edf-a3d7-29f88e369e92 req-48c59f88-d2c7-401d-b5b1-c6b1abf7f1b7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:34.525942 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5db1658a-f106-4edf-a3d7-29f88e369e92 req-48c59f88-d2c7-401d-b5b1-c6b1abf7f1b7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.2148609 May 20 20:29:34.562977 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:34.594703 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Transition to ACTIVE for port object 8901084c-f60b-4b41-82bc-2d359b04000f will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:34.603916 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5db1658a-f106-4edf-a3d7-29f88e369e92 req-6154d966-7e09-4a90-bef9-b23787d31724 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646796 May 20 20:29:34.631425 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:34.637167 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:34.699995 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Network 9c4884cd-a197-48ab-a497-3c07afe55035 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:34.703075 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:34.710213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:29:34.747356 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3a43aec3-f6c1-4460-accb-7fab64db7424 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:34.866512 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:34.874637 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68efcaf5-8f80-4b91-b4b2-aa9f3f33ddc4 req-d4dc81e6-b9b3-4872-9ba4-b50e16feb4aa tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.1685741 May 20 20:29:34.877433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:34.904898 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:34.905512 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:34.932909 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9835892 May 20 20:29:34.939432 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-60e109cd-de34-41b4-a8c9-19678445765e None None] Provisioning for port 8901084c-f60b-4b41-82bc-2d359b04000f completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:34.944237 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-60e109cd-de34-41b4-a8c9-19678445765e None None] Provisioning complete for port 8901084c-f60b-4b41-82bc-2d359b04000f triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:34.944683 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-60e109cd-de34-41b4-a8c9-19678445765e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:34.998224 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-60e109cd-de34-41b4-a8c9-19678445765e None None] Port 8901084c-f60b-4b41-82bc-2d359b04000f cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:29:37.191110 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:37.486250 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-65fdd4b2-d4f7-4040-b0e5-8c0f45fb8ef8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:38.256316 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:39.288857 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Request body: {'port': {'device_id': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:39.406208 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:39.520743 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc67860e-554b-4ae1-81b3-56c5ebc995f1 req-dfa59d41-9f1e-4796-a559-fab8370187d5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:39.524387 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fc67860e-554b-4ae1-81b3-56c5ebc995f1 req-dfa59d41-9f1e-4796-a559-fab8370187d5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0862088 May 20 20:29:39.570835 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fc67860e-554b-4ae1-81b3-56c5ebc995f1 req-a135b1e3-32c7-4104-a340-21971c67ba53 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421331 May 20 20:29:39.750999 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e393797-3502-4fb0-9b45-54e6d6db6a47 req-9ed6d05f-ad59-4e2e-84ec-51395cc5c2e5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:39.752397 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7e393797-3502-4fb0-9b45-54e6d6db6a47 req-9ed6d05f-ad59-4e2e-84ec-51395cc5c2e5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Synchronizing usage tracker for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:29:39.756604 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfc7297-82ea-4fbc-969a-5ff8e3da7041 req-4af63591-ae55-4571-b7ab-20a3553b0e00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:39.758059 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7cfc7297-82ea-4fbc-969a-5ff8e3da7041 req-4af63591-ae55-4571-b7ab-20a3553b0e00 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0871716 May 20 20:29:39.790090 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7e393797-3502-4fb0-9b45-54e6d6db6a47 req-9ed6d05f-ad59-4e2e-84ec-51395cc5c2e5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Unset dirty status for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:29:39.791331 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e393797-3502-4fb0-9b45-54e6d6db6a47 req-9ed6d05f-ad59-4e2e-84ec-51395cc5c2e5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 931 time: 0.2422607 May 20 20:29:39.807524 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7cfc7297-82ea-4fbc-969a-5ff8e3da7041 req-ea4c47a6-8496-43c4-84d5-73bca292c056 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429730 May 20 20:29:39.887880 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:39.902550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8901084c-f60b-4b41-82bc-2d359b04000f {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:29:39.910022 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e393797-3502-4fb0-9b45-54e6d6db6a47 req-4afd8ab8-8d15-4c3d-aa42-9510a7f46a6a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1061587 May 20 20:29:39.913982 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:39.939027 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Transition to ACTIVE for port object 8901084c-f60b-4b41-82bc-2d359b04000f will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:39.949780 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:39.954487 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:39.963582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cc52e311-f2d3-46f0-ab94-8c8b259b9009 req-64ecb2a3-e1da-48e0-b0b9-8fc6aba6868a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Synchronizing usage tracker for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:29:39.981312 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-cc52e311-f2d3-46f0-ab94-8c8b259b9009 req-64ecb2a3-e1da-48e0-b0b9-8fc6aba6868a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Unset dirty status for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:29:39.982541 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cc52e311-f2d3-46f0-ab94-8c8b259b9009 req-64ecb2a3-e1da-48e0-b0b9-8fc6aba6868a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.0775082 May 20 20:29:40.124261 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:40.157051 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:40.356604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Attempting to bind port 8901084c-f60b-4b41-82bc-2d359b04000f on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:29:40.356604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Attempting to bind port 8901084c-f60b-4b41-82bc-2d359b04000f by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:29:40.368061 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Attempting to bind port 8901084c-f60b-4b41-82bc-2d359b04000f on network 9c4884cd-a197-48ab-a497-3c07afe55035 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:40.385781 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Port 8901084c-f60b-4b41-82bc-2d359b04000f on network 9c4884cd-a197-48ab-a497-3c07afe55035 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:29:40.386099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Attempting to bind port 8901084c-f60b-4b41-82bc-2d359b04000f on network 9c4884cd-a197-48ab-a497-3c07afe55035 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:29:40.399434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-12b6881c-4fe3-4952-9862-f4e2a603c793 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:40.400875 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-12b6881c-4fe3-4952-9862-f4e2a603c793 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.69 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 814 time: 0.2734265 May 20 20:29:40.403482 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 29, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:29:40.403839 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Checking segment: {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:29:40.404217 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Bound using segment: {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:29:40.404655 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Bound port: 8901084c-f60b-4b41-82bc-2d359b04000f, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4626296e-819f-49b9-8f67-944cc7c115da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:29:40.405059 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:40.483013 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'port': {'device_id': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'admin_state_up': True, 'tenant_id': '7c0b04802f8b42819b613e195b66efb7'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:29:40.674818 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:29:40.687211 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:29:40.696420 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:40.707178 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c247d7a-9d43-4ee1-bd58-9e78ff5cb6f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:40.754854 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:29:40.821638 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:29:40.832946 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:40.833570 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:40.835788 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] 10.222.0.69 "PUT /v2.0/ports/8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 1093 time: 1.5506492 May 20 20:29:40.839578 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:29:40.883275 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Made reservation on behalf of 7c0b04802f8b42819b613e195b66efb7 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:29:40.891014 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:40.912534 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:40.919052 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:40.986464 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f', 'status': 'completed', 'code': 200} May 20 20:29:41.055141 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b50c94b-afc6-4b32-906c-4528fa9ed5d9 req-e5d5c09b-2c02-49c0-ae32-7a5af2d217de tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:41.060234 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9b50c94b-afc6-4b32-906c-4528fa9ed5d9 req-e5d5c09b-2c02-49c0-ae32-7a5af2d217de tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.3010101 May 20 20:29:41.139202 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68bb6c11-0d79-484e-9ad9-602a43239fc9 req-686d46e4-0598-4885-826d-d079fbe4cc7f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:41.141274 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68bb6c11-0d79-484e-9ad9-602a43239fc9 req-686d46e4-0598-4885-826d-d079fbe4cc7f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0952656 May 20 20:29:41.197317 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68bb6c11-0d79-484e-9ad9-602a43239fc9 req-8cf4bb71-de0a-4452-bf08-6bd92ed121ea tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486627 May 20 20:29:41.300347 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9b50c94b-afc6-4b32-906c-4528fa9ed5d9 req-6c96163f-ce4c-4d11-892e-614bc6d9da0f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2242050 May 20 20:29:41.303085 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Allocated IP 172.20.0.9 (6a4c09f9-50d0-476e-a4d9-6333a5ec1132/cb4537c7-816d-4786-a91f-df295ad528b3/0d67a0d3-7c10-49ac-89c0-e4f771176280) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:29:41.319149 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-c2bae98e-003c-4726-807a-d3f374a5fe7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:41.329159 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-c2bae98e-003c-4726-807a-d3f374a5fe7e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1096 time: 0.3391454 May 20 20:29:41.419838 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d51cdf36-9ada-44a5-b0ca-63eef8cccdcd req-a280ac1b-dd63-45d6-99bd-977142a68485 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.0839365 May 20 20:29:41.597078 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:41.644010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Transition to ACTIVE for port object 0d67a0d3-7c10-49ac-89c0-e4f771176280 will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:29:41.684061 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:41.692070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bbbefe23-9ab4-4ec6-800a-ff35f660debb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:29:41.767221 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:29:41.771050 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:29:41.775255 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:29:41.812895 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:29:41.818704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:29:41.847290 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:29:41.847930 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:41.872856 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4346550 May 20 20:29:42.026221 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-69cb7d97-67cf-4f3b-8196-9be9c27fb9dd None None] Provisioning for port 0d67a0d3-7c10-49ac-89c0-e4f771176280 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:29:42.030815 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-69cb7d97-67cf-4f3b-8196-9be9c27fb9dd None None] Provisioning complete for port 0d67a0d3-7c10-49ac-89c0-e4f771176280 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:29:42.031189 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-69cb7d97-67cf-4f3b-8196-9be9c27fb9dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:42.086335 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-69cb7d97-67cf-4f3b-8196-9be9c27fb9dd None None] Port 0d67a0d3-7c10-49ac-89c0-e4f771176280 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:29:44.964505 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:29:53.796265 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:30:01.294479 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40030) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:01.443616 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:01.458352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:01.463315 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Usage tracker for resource:security_group_rule and tenant:261f3d308cc646949fefc8cd7fa6528c is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:01.466169 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:01.471960 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:01.553548 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:01.557531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:01.565560 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-888bc2be-e63e-4fc4-8730-46b8e9ff0faa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:01.610756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eaba9eaf-2702-4bc3-afc2-44b1d3e637e9,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:01.615858 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:01.623265 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=261f3d308cc646949fefc8cd7fa6528c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3347390 May 20 20:30:01.623400 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 40036) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:01.749112 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:01.776868 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:01.833830 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:01.837889 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-44a13743-3652-4918-b8a8-023922d13714 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:01.850263 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eaba9eaf-2702-4bc3-afc2-44b1d3e637e9,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:01.854664 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:01.860023 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:01.861130 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eaba9eaf-2702-4bc3-afc2-44b1d3e637e9 HTTP/1.1" status: 204 len: 168 time: 0.2366731 May 20 20:30:04.750635 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-19c452b3-b5b5-4202-a03d-0b2da1464507 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:07.194497 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:07.491245 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d8a478d4-eee0-4764-92d3-ab2e343cd160 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:08.259454 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:08.549565 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Request body: {'port': {'device_id': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:08.586025 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-4770e369-780f-4ab0-9a18-36a39b4aadc7 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 217 time: 0.0953789 May 20 20:30:08.719559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-6c36cbcd-feae-40e5-89b3-ad02ba3b527a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:08.721133 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-6c36cbcd-feae-40e5-89b3-ad02ba3b527a service neutron] 10.222.0.69 "GET /v2.0/subnets?id=845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 200 len: 847 time: 0.1119788 May 20 20:30:08.727593 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:08.739272 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-3e5e861d-d319-468e-aeed-ccb8d7ced65f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0796018 May 20 20:30:08.920387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-5abaf48d-8c45-4dcd-9528-49446a099fd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:08.921853 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-5abaf48d-8c45-4dcd-9528-49446a099fd3 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9c4884cd-a197-48ab-a497-3c07afe55035&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1794045 May 20 20:30:08.925811 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-c0795b8b-993a-4bc8-a090-eb8c0423214d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:08.927464 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-c0795b8b-993a-4bc8-a090-eb8c0423214d service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1098 time: 0.1167545 May 20 20:30:09.207084 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-c03197a9-a8d5-4b5b-800c-89e84f86b961 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:09.209085 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-c03197a9-a8d5-4b5b-800c-89e84f86b961 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1972582 May 20 20:30:09.220725 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ddf12b-a16f-4a4f-8af6-1116974ef7a7 req-17770d00-ad7e-4127-b438-47afc94b0283 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:09.226176 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a5ddf12b-a16f-4a4f-8af6-1116974ef7a7 req-17770d00-ad7e-4127-b438-47afc94b0283 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1909492 May 20 20:30:09.272409 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66373746-a647-44c0-8251-94b80dcc8291 req-0ed494b6-8dfc-43ab-a0f7-c821b7768c88 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:09.274359 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66373746-a647-44c0-8251-94b80dcc8291 req-0ed494b6-8dfc-43ab-a0f7-c821b7768c88 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.2945509 May 20 20:30:09.278845 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-ddf47630-1dc4-424d-9ce1-a141a0342805 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3007324 May 20 20:30:09.359093 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-d1d96f1d-c66a-4dd6-abfc-cc8e99ec95ef service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 1000 time: 0.1328580 May 20 20:30:09.361945 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a5ddf12b-a16f-4a4f-8af6-1116974ef7a7 req-c60fb47a-d1a6-406b-9b75-c3459cffea06 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802681 May 20 20:30:09.434523 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-ad3e397a-96b8-45d6-8860-e0b1458bc18f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:09.436447 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-ad3e397a-96b8-45d6-8860-e0b1458bc18f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0606549 May 20 20:30:09.448052 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d67a0d3-7c10-49ac-89c0-e4f771176280 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:30:09.465617 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66373746-a647-44c0-8251-94b80dcc8291 req-0f551ddb-e52b-4bb5-b7b2-c23fb2f5643f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1841722 May 20 20:30:09.467265 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:09.489509 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Transition to ACTIVE for port object 0d67a0d3-7c10-49ac-89c0-e4f771176280 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:30:09.495171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:09.500443 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:09.634012 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a384adc-caf8-45e4-95a0-5352c3069acc req-94e19b11-24c7-4098-8841-35b4822f5187 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:09.642524 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9a384adc-caf8-45e4-95a0-5352c3069acc req-94e19b11-24c7-4098-8841-35b4822f5187 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 943 time: 0.1433556 May 20 20:30:09.681738 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-b9eb17c3-233a-4d7b-bd49-2e3937a4e92c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:09.683534 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-b9eb17c3-233a-4d7b-bd49-2e3937a4e92c service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.2307470 May 20 20:30:09.749367 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-9a384adc-caf8-45e4-95a0-5352c3069acc req-16b13749-dc17-4574-b8ae-f74d7961b5a3 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Synchronizing usage tracker for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:30:09.834780 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cf464110-e59e-46e0-af03-6a0edfb90a71 req-83649aaa-095a-4c6d-889b-9fe2b6cbf573 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5203547 May 20 20:30:09.835521 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Pushing event updated for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:09.852192 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.352s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:09.870967 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-9a384adc-caf8-45e4-95a0-5352c3069acc req-16b13749-dc17-4574-b8ae-f74d7961b5a3 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Unset dirty status for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:30:09.872168 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9a384adc-caf8-45e4-95a0-5352c3069acc req-16b13749-dc17-4574-b8ae-f74d7961b5a3 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2286661 May 20 20:30:09.911457 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:09.916162 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-cd1ca78a-ab71-4b38-bd28-f7ca40bde187 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2109439 May 20 20:30:09.992021 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Attempting to bind port 0d67a0d3-7c10-49ac-89c0-e4f771176280 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:30:09.993112 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Attempting to bind port 0d67a0d3-7c10-49ac-89c0-e4f771176280 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:30:09.993614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Attempting to bind port 0d67a0d3-7c10-49ac-89c0-e4f771176280 on network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:30:10.006356 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Port 0d67a0d3-7c10-49ac-89c0-e4f771176280 on network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:30:10.006676 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Attempting to bind port 0d67a0d3-7c10-49ac-89c0-e4f771176280 on network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:30:10.023382 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 29, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:30:10.023710 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Checking segment: {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:30:10.024500 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Bound using segment: {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:30:10.025279 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Bound port: 0d67a0d3-7c10-49ac-89c0-e4f771176280, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e4d4e68-a93e-461b-b036-66f977f8b866', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 803, 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:30:10.025816 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:10.130994 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-c03f95b3-4768-4ef7-8f2f-75f4a3c8fbc0 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1901667 May 20 20:30:10.185426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-5109075d-622d-40a7-a620-c3d9e68bead3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.187134 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-5109075d-622d-40a7-a620-c3d9e68bead3 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1096 time: 0.2355590 May 20 20:30:10.204009 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:30:10.212576 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:30:10.220480 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:10.225279 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:10.417871 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.418732 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:10.420153 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] 10.222.0.69 "PUT /v2.0/ports/0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 1093 time: 1.8750851 May 20 20:30:10.420643 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:10.454549 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Pushing event updated for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:10.477433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:10.484617 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-67484123-388d-4f09-ae21-f4e36abcfee4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.493634 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-67484123-388d-4f09-ae21-f4e36abcfee4 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 909 time: 0.2242353 May 20 20:30:10.534281 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'status': 'completed', 'code': 200} May 20 20:30:10.656660 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-eff1f770-9571-4496-a1c9-471e974de326 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 217 time: 0.1215873 May 20 20:30:10.693954 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf0db82-b67a-4236-916d-76cc97962a43 req-021427f6-2a65-41a4-bd95-6f635006f5ca tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.695302 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8cf0db82-b67a-4236-916d-76cc97962a43 req-021427f6-2a65-41a4-bd95-6f635006f5ca tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0849974 May 20 20:30:10.740472 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8cf0db82-b67a-4236-916d-76cc97962a43 req-df8b6a5d-22a9-4013-98a7-79af7729a5a7 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390682 May 20 20:30:10.751504 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-bd2bea85-b9e1-4b0b-b586-4747ccf11527 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.752964 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-bd2bea85-b9e1-4b0b-b586-4747ccf11527 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 200 len: 847 time: 0.0752542 May 20 20:30:10.767529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df298a32-1288-4ad3-9643-330724a7e03e req-b0290baf-76f7-439e-94c8-498f259f2785 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.768955 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-df298a32-1288-4ad3-9643-330724a7e03e req-b0290baf-76f7-439e-94c8-498f259f2785 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.2860541 May 20 20:30:10.774934 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-f5d4ae64-353e-4802-919a-884d37014531 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.776089 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-f5d4ae64-353e-4802-919a-884d37014531 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1096 time: 0.2441032 May 20 20:30:10.894806 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-b747b822-9f7e-4980-9583-b2e58a0209bb service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 217 time: 0.0739548 May 20 20:30:10.966609 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-df298a32-1288-4ad3-9643-330724a7e03e req-7047501a-3567-4771-8278-aa6c2ba534d8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1895776 May 20 20:30:10.990774 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-f5a48e78-ccc6-490e-8129-eb0c351f0a85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:10.992234 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-f5a48e78-ccc6-490e-8129-eb0c351f0a85 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 200 len: 853 time: 0.0817840 May 20 20:30:10.999529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-5b3d4c38-324c-46dd-99fb-ad97b0e292ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:11.001008 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-5b3d4c38-324c-46dd-99fb-ad97b0e292ed service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9c4884cd-a197-48ab-a497-3c07afe55035&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.2230659 May 20 20:30:11.076872 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cccc128-5266-4a69-8e1d-3b157c31a817 req-19a91dc6-72f7-4b74-9570-f8b08688f15c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:11.078576 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3cccc128-5266-4a69-8e1d-3b157c31a817 req-19a91dc6-72f7-4b74-9570-f8b08688f15c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 943 time: 0.0862322 May 20 20:30:11.131163 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3cccc128-5266-4a69-8e1d-3b157c31a817 req-3486af4f-0448-49bd-969a-2164a7fa8999 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461462 May 20 20:30:11.204531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-f7162a96-9447-46eb-9603-fb2357e03e21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:11.206065 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-f7162a96-9447-46eb-9603-fb2357e03e21 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1835697 May 20 20:30:11.207940 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-3c389fd1-e6ad-4f42-8451-092465cc9d1f service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1842761 May 20 20:30:11.467330 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-ed27f2dc-ef1c-430b-828b-b5777706f435 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2331917 May 20 20:30:11.470382 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dbc6ce6-95f2-4a00-bf03-655aaad6052d req-7618103a-79d9-48e4-b37b-8175c9d6a812 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2187133 May 20 20:30:11.712317 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ba044ee5-03c9-48cc-85f7-fc3f2632c760 req-e43507e1-d69b-4e30-9fb1-b827c33fa988 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1999171 May 20 20:30:11.938177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-6b158c30-b538-427f-88f6-71708f34b0c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:11.939701 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-6b158c30-b538-427f-88f6-71708f34b0c6 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1096 time: 0.1308961 May 20 20:30:11.956245 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1281c2c0-9525-401e-a8a1-85ff16fcdb9f req-d6cedfbd-464a-438f-8277-4a58618d6e2e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:11.957659 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1281c2c0-9525-401e-a8a1-85ff16fcdb9f req-d6cedfbd-464a-438f-8277-4a58618d6e2e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.1045256 May 20 20:30:12.110326 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1281c2c0-9525-401e-a8a1-85ff16fcdb9f req-9a19fafa-4b9f-48d3-a214-11608d92f3d8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1295550 May 20 20:30:12.144143 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-bba0e88b-38a6-4771-9b32-98650810b1f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:12.145966 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-bba0e88b-38a6-4771-9b32-98650810b1f7 service neutron] 10.222.0.69 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 915 time: 0.1872294 May 20 20:30:12.216596 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48bb374a-8384-46cc-a846-f62f2602a314 req-48a2c005-a959-4963-a295-4efab4d591e8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:12.219676 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-48bb374a-8384-46cc-a846-f62f2602a314 req-48a2c005-a959-4963-a295-4efab4d591e8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1077843 May 20 20:30:12.261896 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-d6205067-860f-4f8f-ba8c-f2bde91b209c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 217 time: 0.0936468 May 20 20:30:12.278131 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-48bb374a-8384-46cc-a846-f62f2602a314 req-57bf6bf0-ec45-4b10-a224-480c035e3c0b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489240 May 20 20:30:12.397154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-d4616f80-5aba-4099-b5ae-6dc411c0d79f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:12.398579 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-d4616f80-5aba-4099-b5ae-6dc411c0d79f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 200 len: 853 time: 0.0852895 May 20 20:30:12.453680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1696e-5bbe-4c2a-99e1-2fe4ab0a13e9 req-7bb347ab-d971-4515-9845-185c59e15d49 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:12.454366 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-b9d1696e-5bbe-4c2a-99e1-2fe4ab0a13e9 req-7bb347ab-d971-4515-9845-185c59e15d49 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Synchronizing usage tracker for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:30:12.492093 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-b9d1696e-5bbe-4c2a-99e1-2fe4ab0a13e9 req-7bb347ab-d971-4515-9845-185c59e15d49 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Unset dirty status for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:30:12.493278 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b9d1696e-5bbe-4c2a-99e1-2fe4ab0a13e9 req-7bb347ab-d971-4515-9845-185c59e15d49 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 943 time: 0.2334259 May 20 20:30:12.524965 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-9ff493dd-baa6-45dc-9b60-97bff2147749 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:12.526304 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-9ff493dd-baa6-45dc-9b60-97bff2147749 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1159959 May 20 20:30:12.545839 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b9d1696e-5bbe-4c2a-99e1-2fe4ab0a13e9 req-ff963b9d-e6b4-44db-bd52-f30dca0e525e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453482 May 20 20:30:12.681458 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-1e47efe3-9fd2-4960-b5bb-6ce7b921302a service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335955 May 20 20:30:12.822074 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3723b57a-7ba3-4580-acc0-998d293aa4ad req-22356edd-e23e-4904-aea1-92eaac7cd9fc service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236148 May 20 20:30:13.305014 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8105ae0-deb6-45d4-83a8-fd2017a58164 req-35bd1b1c-21f7-4365-8cec-97c6e1946c93 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:13.308292 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a8105ae0-deb6-45d4-83a8-fd2017a58164 req-35bd1b1c-21f7-4365-8cec-97c6e1946c93 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0907357 May 20 20:30:13.358643 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a8105ae0-deb6-45d4-83a8-fd2017a58164 req-b0049a71-432b-4296-b653-7971d1887309 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459499 May 20 20:30:13.547881 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84ab428-7699-4730-a5ef-01cb78582401 req-7c81c79d-e492-4099-82a6-171472c76053 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:13.549406 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e84ab428-7699-4730-a5ef-01cb78582401 req-7c81c79d-e492-4099-82a6-171472c76053 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0879190 May 20 20:30:13.596868 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e84ab428-7699-4730-a5ef-01cb78582401 req-160b749c-d6eb-4d5c-b821-87902afe293a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401807 May 20 20:30:13.781550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37d2f12-05e0-475d-8c21-c4b9fab38c59 req-64475c78-ea23-4d65-880d-bb4c2842e71b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:13.783106 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a37d2f12-05e0-475d-8c21-c4b9fab38c59 req-64475c78-ea23-4d65-880d-bb4c2842e71b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0847852 May 20 20:30:13.856705 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a37d2f12-05e0-475d-8c21-c4b9fab38c59 req-ffb04f06-43a4-48d8-aba1-3cdf11dc78c5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519121 May 20 20:30:13.971496 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fa4cfc-1685-4169-a7da-626060901f7e req-f522c9d6-70b9-4476-a48e-b3232ac04e06 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:13.973277 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1fa4cfc-1685-4169-a7da-626060901f7e req-f522c9d6-70b9-4476-a48e-b3232ac04e06 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 943 time: 0.0926638 May 20 20:30:14.018848 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1fa4cfc-1685-4169-a7da-626060901f7e req-ee1c702f-d294-4f0d-8dc4-5b0d5a660566 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390851 May 20 20:30:14.544336 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786e1be9-13a3-4350-aae4-3ef27f17be04 req-ef54ed5c-457e-4612-b93c-3daca6358d5a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:14.545787 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-786e1be9-13a3-4350-aae4-3ef27f17be04 req-ef54ed5c-457e-4612-b93c-3daca6358d5a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0800078 May 20 20:30:14.596423 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-786e1be9-13a3-4350-aae4-3ef27f17be04 req-8e31ffa3-5581-4886-9402-0687d35f7af3 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449712 May 20 20:30:14.783095 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7412985d-9437-4928-890c-ac799f76284b req-7c60624e-8145-40ab-af81-868faba24944 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:14.784472 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7412985d-9437-4928-890c-ac799f76284b req-7c60624e-8145-40ab-af81-868faba24944 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0774527 May 20 20:30:14.831895 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7412985d-9437-4928-890c-ac799f76284b req-a083adc5-d9e5-4aa2-a272-70fe3b671372 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408967 May 20 20:30:14.971528 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:15.060309 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96d25b4-9881-470f-a779-dab59e85b1ed req-f3236616-49de-40c8-bc38-bd1f4b5d7ece tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:15.061682 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d96d25b4-9881-470f-a779-dab59e85b1ed req-f3236616-49de-40c8-bc38-bd1f4b5d7ece tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0819674 May 20 20:30:15.064071 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 0d67a0d3-7c10-49ac-89c0-e4f771176280 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:30:15.109541 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d96d25b4-9881-470f-a779-dab59e85b1ed req-e9a28439-f68f-45b5-9028-6669e90a833d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410509 May 20 20:30:15.203234 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:15.218453 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'port_id': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'mac_address': 'fa:16:3e:73:77:f8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 803, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:30:15.277332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:15.282984 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebbd5bf5-ce09-423f-8db4-84020e22dec8 req-0520de2c-5c56-4406-bacd-f9b5c349823c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:15.284472 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ebbd5bf5-ce09-423f-8db4-84020e22dec8 req-0520de2c-5c56-4406-bacd-f9b5c349823c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 943 time: 0.1601593 May 20 20:30:15.294785 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d67a0d3-7c10-49ac-89c0-e4f771176280 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:30:15.315300 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:15.319270 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:15.321223 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c5b64cad-1191-4abf-8b55-a3b8afa5a03d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:15.333878 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ebbd5bf5-ce09-423f-8db4-84020e22dec8 req-680aa3e2-3c00-471c-8c7e-73e206b684a6 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424974 May 20 20:30:15.387653 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:15.390727 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:15.860579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ed79cc-ae98-4b72-96a4-f29ba6758673 req-a90c3dd4-2ffa-4bf3-85e1-c7b123615bc7 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:15.861930 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-59ed79cc-ae98-4b72-96a4-f29ba6758673 req-a90c3dd4-2ffa-4bf3-85e1-c7b123615bc7 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.1544800 May 20 20:30:15.916181 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-59ed79cc-ae98-4b72-96a4-f29ba6758673 req-0c471dad-f6c8-464e-a26f-a9f3115ac882 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423257 May 20 20:30:15.969684 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['0d67a0d3-7c10-49ac-89c0-e4f771176280'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:30:16.045670 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c89d49-2ae7-4ee5-a8a4-a3af139b8aaf req-7801375e-605d-4fbf-bc52-91ecd5ca48bb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:16.052838 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-57c89d49-2ae7-4ee5-a8a4-a3af139b8aaf req-7801375e-605d-4fbf-bc52-91ecd5ca48bb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0990570 May 20 20:30:16.114679 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-57c89d49-2ae7-4ee5-a8a4-a3af139b8aaf req-ef679717-9a08-4e8d-b82e-936e2ddf28ba tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607302 May 20 20:30:16.319181 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1eba990-55dd-46c3-8594-53d38dcf7aa0 req-1c968f16-afe7-4e76-8d1c-13181917eccc tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:16.320591 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c1eba990-55dd-46c3-8594-53d38dcf7aa0 req-1c968f16-afe7-4e76-8d1c-13181917eccc tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0783637 May 20 20:30:16.369006 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c1eba990-55dd-46c3-8594-53d38dcf7aa0 req-c12e0875-258a-4d75-a0fd-05d620e0f30d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417874 May 20 20:30:16.518728 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee2c2aa-22e4-421c-8a17-10c02b04e4a1 req-22299a31-b062-41be-8820-0f946c4b5dc9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:16.520211 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dee2c2aa-22e4-421c-8a17-10c02b04e4a1 req-22299a31-b062-41be-8820-0f946c4b5dc9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 944 time: 0.0787306 May 20 20:30:16.568784 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dee2c2aa-22e4-421c-8a17-10c02b04e4a1 req-adeb4f17-b411-4ac6-86cd-1d7e6b70c6a0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427928 May 20 20:30:17.116519 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6954ec-0ce5-4b06-a2b6-0eff4ca2b875 req-3658cb93-2251-415b-a6ed-465e0fd2be4d tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:17.118091 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4b6954ec-0ce5-4b06-a2b6-0eff4ca2b875 req-3658cb93-2251-415b-a6ed-465e0fd2be4d tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0837438 May 20 20:30:17.164811 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4b6954ec-0ce5-4b06-a2b6-0eff4ca2b875 req-dd6ff1f4-1347-4250-9131-de5859108149 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407863 May 20 20:30:17.316631 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c62c71-10a4-434f-80d0-a23dd694ac48 req-2f7e05a5-5230-4bac-9728-951bc15aed3b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:17.318113 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c3c62c71-10a4-434f-80d0-a23dd694ac48 req-2f7e05a5-5230-4bac-9728-951bc15aed3b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0781808 May 20 20:30:17.362687 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c3c62c71-10a4-434f-80d0-a23dd694ac48 req-8031578e-d23c-47f0-bcca-647ecf013a45 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381308 May 20 20:30:17.567433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96add2e-9ef3-4d25-ba99-4bd8bf581b4c req-2099711c-c361-4c2d-9a6a-7d4200be892a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:17.568819 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f96add2e-9ef3-4d25-ba99-4bd8bf581b4c req-2099711c-c361-4c2d-9a6a-7d4200be892a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0881553 May 20 20:30:17.616263 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f96add2e-9ef3-4d25-ba99-4bd8bf581b4c req-b6523260-c801-4068-a9aa-a0a6830f4222 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417078 May 20 20:30:17.752798 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b77a04c-a5b8-4fe7-b71c-9125b140b8c6 req-09a3dbfd-ccd9-40f0-b30f-e97283ad6aed tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:17.754238 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2b77a04c-a5b8-4fe7-b71c-9125b140b8c6 req-09a3dbfd-ccd9-40f0-b30f-e97283ad6aed tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 944 time: 0.0816121 May 20 20:30:17.799357 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2b77a04c-a5b8-4fe7-b71c-9125b140b8c6 req-bdf1c559-3607-4056-8a0f-af2107d378e8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385876 May 20 20:30:18.360594 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54a5233-ae79-492c-8224-9385408138f6 req-ddaa129f-d36b-4e22-91d0-d88d7a3bc1da tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:18.362153 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a54a5233-ae79-492c-8224-9385408138f6 req-ddaa129f-d36b-4e22-91d0-d88d7a3bc1da tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0898821 May 20 20:30:18.408458 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a54a5233-ae79-492c-8224-9385408138f6 req-527e0971-1e41-4938-83f4-c3a64c4fa55c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405629 May 20 20:30:18.610033 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0805e0f3-a1e3-43d5-ad4b-8555b9e3bb28 req-0206fc89-658e-455e-9e98-fb9f585832ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:18.611691 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0805e0f3-a1e3-43d5-ad4b-8555b9e3bb28 req-0206fc89-658e-455e-9e98-fb9f585832ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0985098 May 20 20:30:18.664524 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0805e0f3-a1e3-43d5-ad4b-8555b9e3bb28 req-553b4923-34cf-466b-9f26-400378d46060 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468225 May 20 20:30:18.812005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ce5274-e65b-49e0-86de-e5a296308f2c req-31fd9699-aab7-4e18-acd1-943a4066b810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:18.813439 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c1ce5274-e65b-49e0-86de-e5a296308f2c req-31fd9699-aab7-4e18-acd1-943a4066b810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0791781 May 20 20:30:18.858293 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c1ce5274-e65b-49e0-86de-e5a296308f2c req-69f5efa5-46ef-4a48-bebf-6bd52cb206f7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391216 May 20 20:30:18.990177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93412cc9-53be-4942-9c11-7a6b7603825f req-9887d167-fec2-41d1-8274-c4f4002be5e8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:18.991618 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93412cc9-53be-4942-9c11-7a6b7603825f req-9887d167-fec2-41d1-8274-c4f4002be5e8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 944 time: 0.0842261 May 20 20:30:19.036454 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93412cc9-53be-4942-9c11-7a6b7603825f req-e67851d2-8566-434b-b09f-1a4c5a31977b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386932 May 20 20:30:19.103744 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8901084c-f60b-4b41-82bc-2d359b04000f details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:30:19.107855 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 0d67a0d3-7c10-49ac-89c0-e4f771176280 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:30:19.269137 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 0d67a0d3-7c10-49ac-89c0-e4f771176280 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:30:19.276970 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 0d67a0d3-7c10-49ac-89c0-e4f771176280 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:30:19.277343 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:19.345572 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:19.364540 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '8901084c-f60b-4b41-82bc-2d359b04000f', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'port_id': '8901084c-f60b-4b41-82bc-2d359b04000f', 'mac_address': 'fa:16:3e:a6:bd:52', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 849, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:30:19.468451 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:19.491026 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8901084c-f60b-4b41-82bc-2d359b04000f {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:30:19.499396 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:19.523210 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:19.530919 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:19.533305 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-a5185803-d10c-4ab1-8cc6-fa436fd8372b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:19.569477 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:19.594911 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:19.602325 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:19.608039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d732f06-8b6a-44b1-8b3f-ebfbab63701d req-08efb6ed-0d3c-484c-a158-738baa10b354 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:19.609581 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6d732f06-8b6a-44b1-8b3f-ebfbab63701d req-08efb6ed-0d3c-484c-a158-738baa10b354 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 944 time: 0.0922923 May 20 20:30:19.614129 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:19.619470 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:19.619894 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.014s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:19.656425 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'code': 200} May 20 20:30:19.674693 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6d732f06-8b6a-44b1-8b3f-ebfbab63701d req-db639771-3e39-419e-8112-9942bd68be67 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479140 May 20 20:30:19.693396 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:19.697625 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:19.860265 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3af53ac-6f16-4927-bf6e-8f60873ea599 req-e5d7aa09-ae8e-43e1-a27a-7d6c59c07a8f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:19.861707 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d3af53ac-6f16-4927-bf6e-8f60873ea599 req-e5d7aa09-ae8e-43e1-a27a-7d6c59c07a8f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0803561 May 20 20:30:19.961895 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d3af53ac-6f16-4927-bf6e-8f60873ea599 req-125fc32b-7131-40c0-ad96-12d49afc856a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641263 May 20 20:30:19.977139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b016147-04a8-4b86-ab15-7561df1a08a1 req-5f2fc154-95df-4910-839e-5d6d827e6f3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:19.979549 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0b016147-04a8-4b86-ab15-7561df1a08a1 req-5f2fc154-95df-4910-839e-5d6d827e6f3c service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1098 time: 0.1123807 May 20 20:30:20.028413 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0b016147-04a8-4b86-ab15-7561df1a08a1 req-1baf8a73-a430-44af-a9a4-2d1e201c209a service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336542 May 20 20:30:20.054917 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b19ff73-642e-44e6-a30e-12ab9bfbd5d0 req-5e7dd809-9110-4c37-9a3d-8f81d3129067 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:20.057049 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3b19ff73-642e-44e6-a30e-12ab9bfbd5d0 req-5e7dd809-9110-4c37-9a3d-8f81d3129067 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0838311 May 20 20:30:20.108664 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3b19ff73-642e-44e6-a30e-12ab9bfbd5d0 req-86fb3776-5943-48e0-b3df-ed1aca027c82 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453668 May 20 20:30:20.123310 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['8901084c-f60b-4b41-82bc-2d359b04000f'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:30:20.367532 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06e1d14b-74f2-4091-8d76-d08e4fe778c7 req-50fb5d3f-7b97-449e-ad32-90ef809f7b7d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:20.369965 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-06e1d14b-74f2-4091-8d76-d08e4fe778c7 req-50fb5d3f-7b97-449e-ad32-90ef809f7b7d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0810578 May 20 20:30:20.420234 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-06e1d14b-74f2-4091-8d76-d08e4fe778c7 req-c13e76ab-fad2-4213-9c19-bbc7a8f911ed tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441821 May 20 20:30:20.876245 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce6b175-bf2a-4010-8600-d0584d9dc50b req-f0a9e304-f334-48bc-a400-5f26397a587b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:20.877702 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0ce6b175-bf2a-4010-8600-d0584d9dc50b req-f0a9e304-f334-48bc-a400-5f26397a587b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 944 time: 0.0860682 May 20 20:30:20.924522 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0ce6b175-bf2a-4010-8600-d0584d9dc50b req-7de11c54-17d9-42b5-950e-2a2dbca6edf1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410268 May 20 20:30:21.154017 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a169150-692c-45f3-801e-b909f9a5c7ea req-a8ef7a53-b106-4ef2-ad4e-015732b888a9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:21.155799 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2a169150-692c-45f3-801e-b909f9a5c7ea req-a8ef7a53-b106-4ef2-ad4e-015732b888a9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0804811 May 20 20:30:21.201549 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2a169150-692c-45f3-801e-b909f9a5c7ea req-abb62abc-5d3c-4e2a-92e2-622f9333448e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401878 May 20 20:30:21.312798 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50faf962-cc7d-4b1c-b1f0-7a81206b0f8c req-c9424e1a-9201-45a5-8059-ea90ec6c5653 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:21.314245 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-50faf962-cc7d-4b1c-b1f0-7a81206b0f8c req-c9424e1a-9201-45a5-8059-ea90ec6c5653 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0829949 May 20 20:30:21.358960 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-50faf962-cc7d-4b1c-b1f0-7a81206b0f8c req-44a43914-16e4-48ea-9f75-c9bbf70d9ee5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390649 May 20 20:30:21.614610 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71cd90b6-56c1-4f33-b333-4ee20874ea86 req-a6c426d0-773d-4213-9c74-596b93abba6e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:21.616096 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71cd90b6-56c1-4f33-b333-4ee20874ea86 req-a6c426d0-773d-4213-9c74-596b93abba6e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0865967 May 20 20:30:21.667046 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71cd90b6-56c1-4f33-b333-4ee20874ea86 req-25193ab4-9ba4-4de5-a426-749f4e89ea9a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448658 May 20 20:30:22.114610 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d2f04d8-9149-47be-846e-0ae39d7f8da0 req-85cbbdfd-c65b-40b1-a5ba-17a37eeaf610 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:22.119776 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7d2f04d8-9149-47be-846e-0ae39d7f8da0 req-85cbbdfd-c65b-40b1-a5ba-17a37eeaf610 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 944 time: 0.0831232 May 20 20:30:22.161191 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7d2f04d8-9149-47be-846e-0ae39d7f8da0 req-9187d39b-4a4d-469d-a83a-b85be7750d80 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384121 May 20 20:30:22.388823 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad9143b-b837-4ab7-ae9f-a380af67223c req-dceee517-6810-461d-b994-019c2a3217cf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:22.390207 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4ad9143b-b837-4ab7-ae9f-a380af67223c req-dceee517-6810-461d-b994-019c2a3217cf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0783250 May 20 20:30:22.440339 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4ad9143b-b837-4ab7-ae9f-a380af67223c req-4f53885e-098f-4846-b359-6e3aa4ded388 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444698 May 20 20:30:22.554027 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ab2ba6-8004-47e7-adc4-fec115f180e9 req-b86b74bc-0ed9-4da6-8a49-a2295120c31e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:22.555610 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-45ab2ba6-8004-47e7-adc4-fec115f180e9 req-b86b74bc-0ed9-4da6-8a49-a2295120c31e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0824330 May 20 20:30:22.600047 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-45ab2ba6-8004-47e7-adc4-fec115f180e9 req-6a0a6c5a-a6b1-4dde-aead-d02fea12c170 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383606 May 20 20:30:22.850005 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28ea918-1240-481c-9d6d-ae0e01e8b4d9 req-306a2e0c-26e4-402b-8663-f391c20a4f28 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:22.851464 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b28ea918-1240-481c-9d6d-ae0e01e8b4d9 req-306a2e0c-26e4-402b-8663-f391c20a4f28 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0795720 May 20 20:30:22.896268 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b28ea918-1240-481c-9d6d-ae0e01e8b4d9 req-48d483e3-79bc-4fe6-96fd-4514d0291f37 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385580 May 20 20:30:23.081048 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6b60a4-640e-49e6-b8bd-90474ce5c7ac req-96293a5d-4371-408e-be66-d61adc7baa97 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:23.082485 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4b6b60a4-640e-49e6-b8bd-90474ce5c7ac req-96293a5d-4371-408e-be66-d61adc7baa97 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0800514 May 20 20:30:23.128942 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4b6b60a4-640e-49e6-b8bd-90474ce5c7ac req-5be873fb-3f11-4801-a73c-e24b1e558307 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407026 May 20 20:30:23.154324 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8901084c-f60b-4b41-82bc-2d359b04000f up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:30:23.234087 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 8901084c-f60b-4b41-82bc-2d359b04000f completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:30:23.239266 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 8901084c-f60b-4b41-82bc-2d359b04000f triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:30:23.239650 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:23.354685 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7ce8b7-57ce-4f51-a404-f76abb032cdd req-d10f8132-77f7-4ae8-8137-507fe2ad6ebc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:23.356510 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5f7ce8b7-57ce-4f51-a404-f76abb032cdd req-d10f8132-77f7-4ae8-8137-507fe2ad6ebc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 944 time: 0.0827508 May 20 20:30:23.362585 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:23.394823 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:23.405629 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:23.407150 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5f7ce8b7-57ce-4f51-a404-f76abb032cdd req-a345bd9c-e90c-48be-8acf-284deb7a5160 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429473 May 20 20:30:23.410481 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:23.412343 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:23.481246 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f', 'code': 200} May 20 20:30:23.487019 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:23.490576 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:23.569482 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc663661-7999-4fb8-8e6c-d34ee9da49f9 req-fa873706-2cfb-48db-b550-009292a24c7b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:23.571842 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bc663661-7999-4fb8-8e6c-d34ee9da49f9 req-fa873706-2cfb-48db-b550-009292a24c7b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0973268 May 20 20:30:23.616938 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bc663661-7999-4fb8-8e6c-d34ee9da49f9 req-4de8593c-eff5-44d2-a236-b14eb6c4431e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393744 May 20 20:30:23.646238 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf70db7-c6ae-41c9-b751-20f3df297b15 req-0a304f22-a3f0-484a-bd59-369078b68378 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:23.652369 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0cf70db7-c6ae-41c9-b751-20f3df297b15 req-0a304f22-a3f0-484a-bd59-369078b68378 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0905921 May 20 20:30:23.696483 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0cf70db7-c6ae-41c9-b751-20f3df297b15 req-ba0e2e6c-0f6f-47ef-8e65-8c6cc78a8f50 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399401 May 20 20:30:23.824874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc06c72-2596-4ebe-9c30-dcb856044b58 req-8132fcc6-45e4-4931-965a-14e8a4bcc5a3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:23.832890 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dbc06c72-2596-4ebe-9c30-dcb856044b58 req-8132fcc6-45e4-4931-965a-14e8a4bcc5a3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1008928 May 20 20:30:23.878851 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dbc06c72-2596-4ebe-9c30-dcb856044b58 req-ab9d2c19-242d-4bdf-9abb-ed09facc54e8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450268 May 20 20:30:24.028354 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d392196-1e55-4b15-acaf-0bccbf6574a1 req-d7b0fe41-8316-4591-8fb7-d53ebe685141 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:24.029869 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d392196-1e55-4b15-acaf-0bccbf6574a1 req-d7b0fe41-8316-4591-8fb7-d53ebe685141 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1098 time: 0.0809610 May 20 20:30:24.092284 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d392196-1e55-4b15-acaf-0bccbf6574a1 req-2dbf8a30-cd64-4b40-bdc9-52912d6e2041 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384145 May 20 20:30:24.597552 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d19699a5-658e-4386-9324-bd825d889d32 req-f0da2874-f9f0-4710-873e-97b8f0e6571a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:24.598894 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d19699a5-658e-4386-9324-bd825d889d32 req-f0da2874-f9f0-4710-873e-97b8f0e6571a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0786843 May 20 20:30:24.642203 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d19699a5-658e-4386-9324-bd825d889d32 req-c3d11de9-7d1f-45d5-8468-78663c65e964 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367920 May 20 20:30:24.891972 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a248c1-f423-4eba-ad21-b9d5382f7855 req-e0e8733e-e413-4f80-a5d4-a552d6b7af6f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:24.894028 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f1a248c1-f423-4eba-ad21-b9d5382f7855 req-e0e8733e-e413-4f80-a5d4-a552d6b7af6f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0924544 May 20 20:30:25.018547 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f1a248c1-f423-4eba-ad21-b9d5382f7855 req-26df23b0-b2c9-46d8-ba6d-0593da3a87fd tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1184230 May 20 20:30:25.093040 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df07c4e-e640-4c01-a21f-e9bfa73ef9f3 req-39d6d945-55d5-41b9-b0f6-9ff829f44e27 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:25.094516 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3df07c4e-e640-4c01-a21f-e9bfa73ef9f3 req-39d6d945-55d5-41b9-b0f6-9ff829f44e27 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0865576 May 20 20:30:25.140756 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3df07c4e-e640-4c01-a21f-e9bfa73ef9f3 req-fb8ebf3c-ef18-4d71-ae31-ce9f67755076 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401564 May 20 20:30:25.367571 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2894ba01-b6c7-45b3-a86c-da379e35beeb req-a9d50d53-a186-467f-9561-098b04611c1c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:25.369581 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2894ba01-b6c7-45b3-a86c-da379e35beeb req-a9d50d53-a186-467f-9561-098b04611c1c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0873706 May 20 20:30:25.423373 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2894ba01-b6c7-45b3-a86c-da379e35beeb req-32764449-8c86-488f-9963-94b90970d28f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471611 May 20 20:30:25.918001 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74066ad0-fbcc-42d3-bc01-ebc152a5f407 req-41f1f278-36df-4f86-86c0-2df907ffc614 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:25.919676 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-74066ad0-fbcc-42d3-bc01-ebc152a5f407 req-41f1f278-36df-4f86-86c0-2df907ffc614 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.1613693 May 20 20:30:25.971748 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-74066ad0-fbcc-42d3-bc01-ebc152a5f407 req-f21969ee-0967-47e0-a2ad-1b200359eed6 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419402 May 20 20:30:26.214366 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a85e0ac-1b60-46a6-84c0-20abd396e046 req-dc2ef5c4-eb3a-43f1-bff2-788051cb99a0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:26.215869 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2a85e0ac-1b60-46a6-84c0-20abd396e046 req-dc2ef5c4-eb3a-43f1-bff2-788051cb99a0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0843577 May 20 20:30:26.263121 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2a85e0ac-1b60-46a6-84c0-20abd396e046 req-be08f061-2f75-4030-a59b-a6bafb3b4581 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413682 May 20 20:30:26.335544 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2210a77e-2a2a-471a-811c-1f128af63008 req-bf97141e-7c5e-4f30-a0e1-866c3aa116b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:26.337186 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2210a77e-2a2a-471a-811c-1f128af63008 req-bf97141e-7c5e-4f30-a0e1-866c3aa116b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0829322 May 20 20:30:26.382801 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2210a77e-2a2a-471a-811c-1f128af63008 req-6fa57d37-3c7e-411d-9119-142fc398a01d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394397 May 20 20:30:26.614414 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b5e336-b904-43b7-9014-f76d4a48e33a req-2f01c8c8-7b80-4783-86ea-44de0433034b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:26.615880 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a0b5e336-b904-43b7-9014-f76d4a48e33a req-2f01c8c8-7b80-4783-86ea-44de0433034b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0831051 May 20 20:30:26.660522 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a0b5e336-b904-43b7-9014-f76d4a48e33a req-2296fa3b-2170-46e4-b48c-5f0c3b4a80cf tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380738 May 20 20:30:27.159067 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36052ce-b356-4b34-9417-9acd932fca35 req-6d0cabf9-ca07-4d8d-abb4-6cd4f3cd742e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:27.160527 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e36052ce-b356-4b34-9417-9acd932fca35 req-6d0cabf9-ca07-4d8d-abb4-6cd4f3cd742e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0788946 May 20 20:30:27.207651 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e36052ce-b356-4b34-9417-9acd932fca35 req-b724772b-7afc-46b5-8894-a0ff735893ff tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405953 May 20 20:30:27.395786 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20b24f67-762c-4928-9943-eabf3f11bc1a req-ed3f0ea1-8096-4843-ac9c-870d047a6d26 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:27.397421 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20b24f67-762c-4928-9943-eabf3f11bc1a req-ed3f0ea1-8096-4843-ac9c-870d047a6d26 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0807264 May 20 20:30:27.455857 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2bc64d-b4ba-4621-b561-d48e246f2e8b req-aa90da92-30d9-4684-afd1-f4dd47734d73 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:27.456402 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20b24f67-762c-4928-9943-eabf3f11bc1a req-b6781769-b4c7-44a0-8db7-981c3c5fb038 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509291 May 20 20:30:27.457526 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-de2bc64d-b4ba-4621-b561-d48e246f2e8b req-aa90da92-30d9-4684-afd1-f4dd47734d73 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0865753 May 20 20:30:27.483113 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40312) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:27.523917 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-de2bc64d-b4ba-4621-b561-d48e246f2e8b req-05f31901-50c2-43e0-ae30-6753588025a7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584061 May 20 20:30:27.730072 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b897fec1-6c24-4739-ba19-a7e9fbfee8f9 req-f7fccc2f-5a2d-48f4-88e9-7cd8c04fbccd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:27.731625 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b897fec1-6c24-4739-ba19-a7e9fbfee8f9 req-f7fccc2f-5a2d-48f4-88e9-7cd8c04fbccd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1292403 May 20 20:30:27.798971 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b897fec1-6c24-4739-ba19-a7e9fbfee8f9 req-107ca155-0b78-4def-8516-2d35d2f977c0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0589764 May 20 20:30:27.809186 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7f83eb6-317e-4e15-9142-35e91a4159d8 tempest-TestShelveInstance-262517169 tempest-TestShelveInstance-262517169-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:27.811957 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-b7f83eb6-317e-4e15-9142-35e91a4159d8 tempest-TestShelveInstance-262517169 tempest-TestShelveInstance-262517169-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1093 time: 0.3270767 May 20 20:30:27.813798 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40334) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:27.827351 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'port_id': '8901084c-f60b-4b41-82bc-2d359b04000f', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'fixed_ip_address': '172.20.0.5'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:27.827638 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:27.831541 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Usage tracker for resource:floatingip and tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:27.832359 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-f579b25e-7e34-4e8d-a06b-4ececbd8d0e9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:27.834031 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-f579b25e-7e34-4e8d-a06b-4ececbd8d0e9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 0.1480088 May 20 20:30:27.834666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:27.841488 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:27.854763 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-851b1283-a056-4bc6-aa4d-cc436c4bfe4f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/quotas/6eec95c790c84cfc8a6a2fbd90bb926c HTTP/1.1" status: 200 len: 375 time: 0.0129454 May 20 20:30:27.855028 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for floatingip, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:27.960695 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-644674ec-1cb3-4ce7-ae54-bea4be130155 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0957911 May 20 20:30:28.061497 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c08e9fd5-34a3-42ab-b323-835fc495eef1 req-ea8bfedd-12b7-49f6-bcf9-3d9cfb182612 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:28.062973 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c08e9fd5-34a3-42ab-b323-835fc495eef1 req-ea8bfedd-12b7-49f6-bcf9-3d9cfb182612 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1107905 May 20 20:30:28.065745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:28.097739 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-76eb8e73-1550-4a17-9740-0e2c00a2fafd service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269605 May 20 20:30:28.166443 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c08e9fd5-34a3-42ab-b323-835fc495eef1 req-f754e24e-e418-45a4-b92c-8d520f6502c1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632510 May 20 20:30:28.240936 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-8a691735-9d56-4706-8612-926165efe42c service neutron] 10.222.0.82 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1372969 May 20 20:30:28.254608 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Allocated IP 172.27.3.114 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/0871a2a1-32fb-4e72-8bbd-4ee49b62fa7c) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:30:28.451725 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-527cc57d-78e5-43b0-83ed-57e71dccefe2 req-22639f7f-a934-48fb-b304-3babf1f14480 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 210 time: 0.0628636 May 20 20:30:28.459644 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:28.494611 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:28.498282 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65e5243d-0e64-4853-bee7-6cfa2b433370 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:28.564843 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:30:28.567772 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:30:28.572045 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:30:28.629561 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'Port': ['ID=0871a2a1-32fb-4e72-8bbd-4ee49b62fa7c,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:28.674223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.674939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.674939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.675287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.675622 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.676015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.676386 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.676747 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.677108 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.677495 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.677811 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.678188 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:28.688727 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:28.721814 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82803c71-97fd-404a-a7a4-05970adab751 req-836ced35-b248-4798-aa90-22230d00acdf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:28.723592 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-82803c71-97fd-404a-a7a4-05970adab751 req-836ced35-b248-4798-aa90-22230d00acdf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0870755 May 20 20:30:28.771566 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-82803c71-97fd-404a-a7a4-05970adab751 req-ae244b17-6224-40aa-9537-ede5b5609b5c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406909 May 20 20:30:29.116777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251410aa-a463-46cf-8354-05e7dbef4700 req-b33bb136-accf-40de-8c65-048d63604fe6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:29.118387 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-251410aa-a463-46cf-8354-05e7dbef4700 req-b33bb136-accf-40de-8c65-048d63604fe6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.2022209 May 20 20:30:29.181924 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-251410aa-a463-46cf-8354-05e7dbef4700 req-d78bd5b8-b39f-44d9-81e6-a08622a0c12b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576560 May 20 20:30:29.193625 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:29.282868 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:29.390538 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08b404f-f66f-4fa7-a965-77a84d4ace7c req-0dd74f71-1c74-4aa6-9fbf-c3dee635dadd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:29.392008 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e08b404f-f66f-4fa7-a965-77a84d4ace7c req-0dd74f71-1c74-4aa6-9fbf-c3dee635dadd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1035094 May 20 20:30:29.440878 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e08b404f-f66f-4fa7-a965-77a84d4ace7c req-bbe6a813-7c3d-434e-8977-d047190c11db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422177 May 20 20:30:29.490684 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:29.495684 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:29.499479 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3ca8f33a-69ea-4b5a-800a-a700131be018 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:29.643080 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e0b7b5d0-f647-43a1-9e3f-fd498a985127 req-12d6029b-893d-4e5c-9712-272d468f9b90 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 210 time: 0.0614064 May 20 20:30:29.648041 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event updated for resources: {'Port': ['ID=0871a2a1-32fb-4e72-8bbd-4ee49b62fa7c,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:29.652703 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:29.659604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:29.832694 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Floating IP ed522ab9-dfc3-4e3d-bceb-ddda4cba0995 associated. External IP: 172.27.3.114, port: 8901084c-f60b-4b41-82bc-2d359b04000f. May 20 20:30:29.997747 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5649a43-747d-4b1b-b6f7-68d55004464f req-ef8592e8-2d3a-47c0-b458-33e7b857470e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:30.000005 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c5649a43-747d-4b1b-b6f7-68d55004464f req-ef8592e8-2d3a-47c0-b458-33e7b857470e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1088092 May 20 20:30:30.060311 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c5649a43-747d-4b1b-b6f7-68d55004464f req-934cf854-71f0-4636-9dc3-c47bd455a835 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515881 May 20 20:30:30.264975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-788862f4-767f-4745-9ed5-9f1fe22fe1ed tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:30.266417 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-788862f4-767f-4745-9ed5-9f1fe22fe1ed tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 815 time: 0.2592499 May 20 20:30:30.331908 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Request body: {'port': {'device_id': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'admin_state_up': True, 'tenant_id': '6eec95c790c84cfc8a6a2fbd90bb926c'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:30.612123 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Router e82a2c25-7086-45e3-b880-9d510f38463a has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:30:30.635340 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea41de35-7447-4010-b14e-1054b611b36c req-3f87ee3f-1778-4e3c-8b54-dda5e7194292 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:30.636910 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ea41de35-7447-4010-b14e-1054b611b36c req-3f87ee3f-1778-4e3c-8b54-dda5e7194292 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0839818 May 20 20:30:30.682701 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ea41de35-7447-4010-b14e-1054b611b36c req-83ea037a-5b27-4d83-beb9-c7d8669aa23d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398686 May 20 20:30:30.725863 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbc4b8ef-141c-44fb-a225-e378961c314e req-9756cdf7-7b2d-4578-bdc6-9d078ac27b95 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:30.727330 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cbc4b8ef-141c-44fb-a225-e378961c314e req-9756cdf7-7b2d-4578-bdc6-9d078ac27b95 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.3994062 May 20 20:30:30.761145 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:30.797029 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:30.809168 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:30:30.831798 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f8be2059-0d18-4dee-aabe-48beb9e5168c req-0eba567e-e715-40ef-85ca-f5fe3abcb8bb tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 210 time: 0.0486138 May 20 20:30:30.885987 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cbc4b8ef-141c-44fb-a225-e378961c314e req-f2f06fd2-1c51-4c8d-aa52-6d6aed1e252f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1440921 May 20 20:30:30.898875 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Made reservation on behalf of 6eec95c790c84cfc8a6a2fbd90bb926c for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:30:30.902833 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:30.922413 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:30:30.936767 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] Sync routers for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:30:30.947125 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:30:30.947951 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:30:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:31.024291 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:31.143867 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.3177557 May 20 20:30:31.143867 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:31.144144 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:30:31.159933 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Allocated IP 172.20.0.12 (2021d324-55d7-4959-b1a9-ee3e58b34538/8debe367-8908-48d3-a2e2-6afb3c3cda2a/8be5d189-5a62-4f11-8908-3833ca76d63e) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:30:31.213928 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f', 'status': 'completed', 'code': 200} May 20 20:30:31.266633 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375eaa63-7286-4b8a-b434-fdc0eb6d8f31 req-6049065c-cd5a-4af8-b93c-220a962102ac tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:31.268157 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-375eaa63-7286-4b8a-b434-fdc0eb6d8f31 req-6049065c-cd5a-4af8-b93c-220a962102ac tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0926304 May 20 20:30:31.322306 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-375eaa63-7286-4b8a-b434-fdc0eb6d8f31 req-d29529f3-162b-4c81-a920-5eab79a140da tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481277 May 20 20:30:31.451812 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:31.457994 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-7744b6d3-39e8-4f17-996e-ea19cbe6a9b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:31.459652 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-7744b6d3-39e8-4f17-996e-ea19cbe6a9b1 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1098 time: 0.2081790 May 20 20:30:31.505455 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'ed522ab9-dfc3-4e3d-bceb-ddda4cba0995', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'floating_ip_address': '172.27.3.114', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'port_id': '8901084c-f60b-4b41-82bc-2d359b04000f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 419, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'mac_address': 'fa:16:3e:a6:bd:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:30:29Z', 'updated_at': '2021-05-20T20:30:29Z', 'revision_number': 0, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 5, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:31.510858 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:31.511206 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] Checking router: e82a2c25-7086-45e3-b880-9d510f38463a for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:30:31.520260 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:30:31.520575 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:31.520870 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:30:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:31.537870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4', '08f701b8-1580-4323-b2f2-c088e14e4e28', '90dacfdb-310f-446a-a389-3184996fd51e'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:30:31.601569 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Network 2021d324-55d7-4959-b1a9-ee3e58b34538 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:30:31.607744 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:30:31.612461 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:30:31.715714 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:30:31.737511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event updated for resources: {'Port': ['ID=8be5d189-5a62-4f11-8908-3833ca76d63e,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:31.747901 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:31.778555 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:31.779189 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:31.800094 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-1b0480c3-1bdb-46c4-b531-928054a2ba6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:31.801551 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-1b0480c3-1bdb-46c4-b531-928054a2ba6e service neutron] 10.222.0.69 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 909 time: 0.3119676 May 20 20:30:31.809571 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4826908 May 20 20:30:31.873660 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Request body: {'port': {'device_id': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:32.031124 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-f7b72c19-c8d5-41e7-8af1-356fdad66858 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 999 time: 0.2192070 May 20 20:30:32.039402 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a93477-c3cc-4290-ae92-bb0863210fc9 req-93a3ce88-0905-4a23-85ee-8a9364b32133 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:32.049341 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e5a93477-c3cc-4290-ae92-bb0863210fc9 req-93a3ce88-0905-4a23-85ee-8a9364b32133 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 932 time: 0.0966241 May 20 20:30:32.092442 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e5a93477-c3cc-4290-ae92-bb0863210fc9 req-5c258f7c-8fd1-49cd-8c51-d53e46957890 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422366 May 20 20:30:32.125153 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'ed522ab9-dfc3-4e3d-bceb-ddda4cba0995', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'floating_ip_address': '172.27.3.114', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'port_id': '8901084c-f60b-4b41-82bc-2d359b04000f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 419, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'mac_address': 'fa:16:3e:a6:bd:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:30:29Z', 'updated_at': '2021-05-20T20:30:29Z', 'revision_number': 0, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 5, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:32.129607 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aae9a201-6252-4b11-84bf-1f8782454350 None None] The sync data for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi is: [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'ed522ab9-dfc3-4e3d-bceb-ddda4cba0995', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'floating_ip_address': '172.27.3.114', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'port_id': '8901084c-f60b-4b41-82bc-2d359b04000f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 419, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'mac_address': 'fa:16:3e:a6:bd:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:30:29Z', 'updated_at': '2021-05-20T20:30:29Z', 'revision_number': 0, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 5, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:30:32.155193 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:32.166823 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-fc2ac832-2dd5-434f-8a75-12317c66cc13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:32.168568 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-fc2ac832-2dd5-434f-8a75-12317c66cc13 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 200 len: 847 time: 0.1066101 May 20 20:30:32.178530 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0625cd1-34a9-4ce9-9f7b-a007291ea8b3 req-5373c7d7-9f9c-4f6b-a5ae-a26d6aa6e74a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:32.180128 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c0625cd1-34a9-4ce9-9f7b-a007291ea8b3 req-5373c7d7-9f9c-4f6b-a5ae-a26d6aa6e74a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.3111458 May 20 20:30:32.278301 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b39d3e-ced2-4bc8-901c-16fca7dfe298 req-52c31ce8-efcc-4d08-ae34-b13350f4c8e0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:32.279943 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-56b39d3e-ced2-4bc8-901c-16fca7dfe298 req-52c31ce8-efcc-4d08-ae34-b13350f4c8e0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0858965 May 20 20:30:32.329910 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-56b39d3e-ced2-4bc8-901c-16fca7dfe298 req-c259f7c1-9542-422a-97f0-0fd99851c750 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441480 May 20 20:30:32.385548 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a038401a-2172-484f-9bda-354d319cd250 None None] New status for floating IP ed522ab9-dfc3-4e3d-bceb-ddda4cba0995: ACTIVE {{(pid=91647) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:30:32.503864 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c0625cd1-34a9-4ce9-9f7b-a007291ea8b3 req-fefb970d-b2a6-4572-90c1-298f828e66a8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3143792 May 20 20:30:32.583972 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-697b4933-95fa-4f29-9bf6-8be93c3192a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:32.584360 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-697b4933-95fa-4f29-9bf6-8be93c3192a1 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9c4884cd-a197-48ab-a497-3c07afe55035&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.3658743 May 20 20:30:32.797870 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99fac266-ff95-485b-a14c-e366f433acd6 req-3c2f0009-b3f2-4a3e-bc86-5462c5bbe7b8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:32.799334 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-99fac266-ff95-485b-a14c-e366f433acd6 req-3c2f0009-b3f2-4a3e-bc86-5462c5bbe7b8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.2005327 May 20 20:30:32.834731 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-9c86f7af-3d22-468a-b01d-28ecb9155c49 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1833773 May 20 20:30:32.845746 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-99fac266-ff95-485b-a14c-e366f433acd6 req-566804af-c33e-4e0f-a42e-80690ca0e183 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392244 May 20 20:30:32.968463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8be5d189-5a62-4f11-8908-3833ca76d63e {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:30:32.979593 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:33.008313 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Transition to ACTIVE for port object 8be5d189-5a62-4f11-8908-3833ca76d63e will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:30:33.014450 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:33.026801 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:33.129189 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b602b56-db0d-4ef3-9cf5-a0fbd475f64a req-022bec3a-c3df-4f59-b5ad-7ebc8d13c573 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2616425 May 20 20:30:33.187517 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Pushing event updated for resources: {'Port': ['ID=8be5d189-5a62-4f11-8908-3833ca76d63e,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:33.194202 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:33.316637 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Attempting to bind port 8be5d189-5a62-4f11-8908-3833ca76d63e on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:30:33.316965 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Attempting to bind port 8be5d189-5a62-4f11-8908-3833ca76d63e by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:30:33.317287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Attempting to bind port 8be5d189-5a62-4f11-8908-3833ca76d63e on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:30:33.325058 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Port 8be5d189-5a62-4f11-8908-3833ca76d63e on network 2021d324-55d7-4959-b1a9-ee3e58b34538 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:30:33.325368 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Attempting to bind port 8be5d189-5a62-4f11-8908-3833ca76d63e on network 2021d324-55d7-4959-b1a9-ee3e58b34538 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:30:33.332999 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 30, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:30:33.333327 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Checking segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:30:33.333705 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Bound using segment: {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:30:33.334121 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Bound port: 8be5d189-5a62-4f11-8908-3833ca76d63e, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1fc195ac-b83c-4c30-9312-57e0ea98cebc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:30:33.334462 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:33.351066 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fb35ca-ebd9-458e-a77e-0e33290f3ed3 req-5c073a00-36af-43b8-80e3-41741b22e4f1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:33.351755 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-f2fb35ca-ebd9-458e-a77e-0e33290f3ed3 req-5c073a00-36af-43b8-80e3-41741b22e4f1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:30:33.415205 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-f2fb35ca-ebd9-458e-a77e-0e33290f3ed3 req-5c073a00-36af-43b8-80e3-41741b22e4f1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:30:33.416828 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f2fb35ca-ebd9-458e-a77e-0e33290f3ed3 req-5c073a00-36af-43b8-80e3-41741b22e4f1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 944 time: 0.1949039 May 20 20:30:33.474350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] For port 8be5d189-5a62-4f11-8908-3833ca76d63e, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:30:33.488981 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f2fb35ca-ebd9-458e-a77e-0e33290f3ed3 req-f96130ef-bbe0-4838-8506-ef482d5e6082 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540857 May 20 20:30:33.490433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] For port 8be5d189-5a62-4f11-8908-3833ca76d63e, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8be5d189-5a62-4f11-8908-3833ca76d63e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:30:33.496164 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:33.499993 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2ca1c1ef-eb40-455c-99c3-4293dc9da77f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:33.533496 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d58bfed-32fe-4484-8ab8-5500cbde36ab req-63cc7488-ddfa-4e27-9256-de378cfa5892 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:33.541820 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9d58bfed-32fe-4484-8ab8-5500cbde36ab req-63cc7488-ddfa-4e27-9256-de378cfa5892 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0926321 May 20 20:30:33.562135 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:33.562750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:33.564146 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] 10.222.0.69 "PUT /v2.0/ports/8be5d189-5a62-4f11-8908-3833ca76d63e HTTP/1.1" status: 200 len: 1094 time: 1.6969411 May 20 20:30:33.564628 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'tag': '8be5d189-5a62-4f11-8908-3833ca76d63e'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:33.587481 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9d58bfed-32fe-4484-8ab8-5500cbde36ab req-def06a1f-6880-40c7-9bfd-2ed164e26414 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451779 May 20 20:30:33.588729 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Pushing event updated for resources: {'Port': ['ID=8be5d189-5a62-4f11-8908-3833ca76d63e,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:33.592028 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:33.660469 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'tag': '8be5d189-5a62-4f11-8908-3833ca76d63e', 'status': 'completed', 'code': 200} May 20 20:30:33.765017 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cfcf5736-7c4a-48c7-8c3f-b01a84bf96d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:33.766487 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-cfcf5736-7c4a-48c7-8c3f-b01a84bf96d6 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 1097 time: 0.1053023 May 20 20:30:33.776014 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ce1f16-2b0c-44d8-a324-6d6ac23af052 req-585ff650-bc73-44ae-856c-f9efd3e31b19 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:33.777295 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a9ce1f16-2b0c-44d8-a324-6d6ac23af052 req-585ff650-bc73-44ae-856c-f9efd3e31b19 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1494610 May 20 20:30:33.867121 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-4c0898e4-0ab7-4ba4-b5a8-136004ed8bce service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8be5d189-5a62-4f11-8908-3833ca76d63e HTTP/1.1" status: 200 len: 217 time: 0.0679395 May 20 20:30:33.880025 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a9ce1f16-2b0c-44d8-a324-6d6ac23af052 req-6b182d6e-6c15-402c-94ed-98ead0e59722 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0969844 May 20 20:30:33.951324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-9f48eebc-e757-4b5d-8343-d5567fd9d7eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:33.952807 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-9f48eebc-e757-4b5d-8343-d5567fd9d7eb service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.0648949 May 20 20:30:34.026361 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-1a9cf541-56f0-405b-8c43-ad71eb3fbd8e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409307 May 20 20:30:34.033808 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5548f4b9-9e2b-4567-9f8b-6cd8ef985019 req-ccae7eb3-0712-402c-8c31-0d5b333c9ccc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:34.035239 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5548f4b9-9e2b-4567-9f8b-6cd8ef985019 req-ccae7eb3-0712-402c-8c31-0d5b333c9ccc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0792682 May 20 20:30:34.080435 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5548f4b9-9e2b-4567-9f8b-6cd8ef985019 req-5d19883d-e2ef-4d84-b1dc-3a348a9b5099 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394907 May 20 20:30:34.166785 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-efd31de9-5bf8-4445-8ff4-475cd2b982c6 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235135 May 20 20:30:34.403981 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b0faef-aa6d-4e70-9501-4a9fe7eaa2bd req-6b8dc40c-8fbd-490a-aaab-53e81ed7e553 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2084002 May 20 20:30:34.573193 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f24288-ec4d-474d-a245-0784fa04f876 req-b22e451a-0e9d-47cb-b95a-963b712034a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:34.574711 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-47f24288-ec4d-474d-a245-0784fa04f876 req-b22e451a-0e9d-47cb-b95a-963b712034a9 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 1097 time: 0.0740583 May 20 20:30:34.755997 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7752b05a-4671-48a3-bde7-28f71574917c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:34.784976 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f24288-ec4d-474d-a245-0784fa04f876 req-e2a6d733-d40f-497b-8231-98ff19a7ebb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:34.786458 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-47f24288-ec4d-474d-a245-0784fa04f876 req-e2a6d733-d40f-497b-8231-98ff19a7ebb6 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 200 len: 916 time: 0.1907356 May 20 20:30:34.795773 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fbc26e-f484-4ace-8fe3-c7b8395604a4 req-4baf8993-8c41-4b1c-a2a5-f7c1c2c5f857 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:34.797254 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-59fbc26e-f484-4ace-8fe3-c7b8395604a4 req-4baf8993-8c41-4b1c-a2a5-f7c1c2c5f857 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0872025 May 20 20:30:34.799378 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54131430-8b2d-4d77-b58b-04328d085349 req-e2e1ac79-e0d1-4420-964e-a59457b5171d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:34.800831 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-54131430-8b2d-4d77-b58b-04328d085349 req-e2e1ac79-e0d1-4420-964e-a59457b5171d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 944 time: 0.1848631 May 20 20:30:34.845595 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-59fbc26e-f484-4ace-8fe3-c7b8395604a4 req-572ec016-b015-4091-bcbc-6673e448b2ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422015 May 20 20:30:34.895957 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-47f24288-ec4d-474d-a245-0784fa04f876 req-0b6ff6ca-95a5-40af-99eb-15ec7869311a service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8be5d189-5a62-4f11-8908-3833ca76d63e HTTP/1.1" status: 200 len: 217 time: 0.0723002 May 20 20:30:34.916287 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-54131430-8b2d-4d77-b58b-04328d085349 req-883a625b-bfb3-4d80-8843-b32d896b8182 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1088188 May 20 20:30:34.976574 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f24288-ec4d-474d-a245-0784fa04f876 req-3bb58bb8-6bf5-4fd5-9b38-043ec2ba1e5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:34.978057 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-47f24288-ec4d-474d-a245-0784fa04f876 req-3bb58bb8-6bf5-4fd5-9b38-043ec2ba1e5a service neutron] 10.222.0.69 "GET /v2.0/subnets?id=8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 200 len: 855 time: 0.0652406 May 20 20:30:35.042497 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-47f24288-ec4d-474d-a245-0784fa04f876 req-fe431ceb-36d2-426d-8593-aa10d4adcf48 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2021d324-55d7-4959-b1a9-ee3e58b34538&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409088 May 20 20:30:35.069170 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ddac84-1ac9-4d3a-82c1-f84d0818f56b req-a6f32e13-4d96-4a07-8cce-577c4675afcf tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:35.070921 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-69ddac84-1ac9-4d3a-82c1-f84d0818f56b req-a6f32e13-4d96-4a07-8cce-577c4675afcf tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0829358 May 20 20:30:35.117494 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-69ddac84-1ac9-4d3a-82c1-f84d0818f56b req-2efa7e9a-bde6-49d8-bcc9-4946dfb2fd91 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408223 May 20 20:30:35.224053 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-47f24288-ec4d-474d-a245-0784fa04f876 req-b25caede-d5eb-49b4-be2b-1cfb344de58d service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1561394 May 20 20:30:35.370840 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddf84cd5-082f-412f-9e69-055d5caa9f77 req-ef32f271-cff7-42cc-adfc-566c73a02ba2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:35.372364 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ddf84cd5-082f-412f-9e69-055d5caa9f77 req-ef32f271-cff7-42cc-adfc-566c73a02ba2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1818600 May 20 20:30:35.416762 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-47f24288-ec4d-474d-a245-0784fa04f876 req-96fa4e18-81d7-4d7b-97ed-21b3d19dfd05 service neutron] 10.222.0.69 "GET /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1697421 May 20 20:30:35.437473 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ddf84cd5-082f-412f-9e69-055d5caa9f77 req-be41055d-0270-4882-9ca0-bb06fc982b4e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590568 May 20 20:30:36.047790 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c56d7f5-91b2-4294-aee0-e33a5f3325b8 req-eba43b39-ac2a-450c-a20b-8abd27fb8417 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:36.049304 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5c56d7f5-91b2-4294-aee0-e33a5f3325b8 req-eba43b39-ac2a-450c-a20b-8abd27fb8417 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0916348 May 20 20:30:36.097753 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5c56d7f5-91b2-4294-aee0-e33a5f3325b8 req-19ce0df5-0c6b-468b-92b5-f90ede29cf95 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422411 May 20 20:30:36.111967 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ae0555-d8d4-4949-8a8c-23df456c3ff1 req-c29e2658-4155-47ac-a109-258cb3617f7a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:36.119168 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-69ae0555-d8d4-4949-8a8c-23df456c3ff1 req-c29e2658-4155-47ac-a109-258cb3617f7a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 944 time: 0.0925546 May 20 20:30:36.162051 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-69ae0555-d8d4-4949-8a8c-23df456c3ff1 req-d5e7125b-f9ff-4d3c-9d3b-8f5f5c446b9c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420001 May 20 20:30:36.307116 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88187e8b-c3fd-4f49-b95c-d7309124ee0e req-4cb89279-3b4d-4f37-ba51-e298315f9f66 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:36.308626 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-88187e8b-c3fd-4f49-b95c-d7309124ee0e req-4cb89279-3b4d-4f37-ba51-e298315f9f66 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0784681 May 20 20:30:36.356492 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cbb81d-5ca8-4ca2-bfda-5be6c5cf5675 req-d72124a2-da7c-419a-806d-cb013682efd3 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:36.357936 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-10cbb81d-5ca8-4ca2-bfda-5be6c5cf5675 req-d72124a2-da7c-419a-806d-cb013682efd3 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0841246 May 20 20:30:36.358599 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-88187e8b-c3fd-4f49-b95c-d7309124ee0e req-a893f0de-e701-4b92-bc5a-820e51a30f4b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434327 May 20 20:30:36.403024 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-10cbb81d-5ca8-4ca2-bfda-5be6c5cf5675 req-3f94485f-c066-493a-b75e-d56ef3315f7c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394864 May 20 20:30:36.425926 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40428) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:36.609831 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-717c0663-ac81-4102-99d3-5c968161da11 tempest-TestMinimumBasicScenario-511363336 tempest-TestMinimumBasicScenario-511363336-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:36.611357 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-717c0663-ac81-4102-99d3-5c968161da11 tempest-TestMinimumBasicScenario-511363336 tempest-TestMinimumBasicScenario-511363336-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1093 time: 0.1844282 May 20 20:30:36.614640 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40436) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:36.622296 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'port_id': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'fixed_ip_address': '172.20.0.9'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:36.627456 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af680602-37dd-401b-8b28-05dde7208c99 req-e77d0d56-236a-41cb-91b3-f9064e89cb42 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:36.628031 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:36.628935 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-af680602-37dd-401b-8b28-05dde7208c99 req-e77d0d56-236a-41cb-91b3-f9064e89cb42 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0837970 May 20 20:30:36.631862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:floatingip and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:36.635745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:36.641461 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:36.655439 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for floatingip, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:36.675630 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-af680602-37dd-401b-8b28-05dde7208c99 req-9e76ba6a-ccd2-461a-8fd0-0a05dfb690d7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407002 May 20 20:30:36.794789 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:36.942749 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Allocated IP 172.27.3.145 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/080bba6c-30e4-43d8-a64f-1ffc4b054de9) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:30:37.171594 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:37.205356 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:37.216549 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:37.221619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:37.244421 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8be5d189-5a62-4f11-8908-3833ca76d63e details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:30:37.344586 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:30:37.356785 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:30:37.362277 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:30:37.390933 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'Port': ['ID=080bba6c-30e4-43d8-a64f-1ffc4b054de9,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:37.402583 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:37.408163 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8be5d189-5a62-4f11-8908-3833ca76d63e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8be5d189-5a62-4f11-8908-3833ca76d63e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:37.411730 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d995f02a-72d2-473e-b5d2-9d7382fe41e5 req-22cb9385-f39f-4629-b75a-7c6ff56d20a1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:37.413660 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d995f02a-72d2-473e-b5d2-9d7382fe41e5 req-22cb9385-f39f-4629-b75a-7c6ff56d20a1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 944 time: 0.1129582 May 20 20:30:37.431569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '8be5d189-5a62-4f11-8908-3833ca76d63e', 'network_id': '2021d324-55d7-4959-b1a9-ee3e58b34538', 'port_id': '8be5d189-5a62-4f11-8908-3833ca76d63e', 'mac_address': 'fa:16:3e:ed:5a:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8debe367-8908-48d3-a2e2-6afb3c3cda2a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:30:37.480545 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d995f02a-72d2-473e-b5d2-9d7382fe41e5 req-53092391-3094-43cb-a4d9-64356ec57508 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596857 May 20 20:30:37.507051 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78a85ed6-752d-4a0f-8d05-568aac49977f req-e9f51ddc-48f2-4bcc-b96c-d7e9b339710d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:37.511375 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-78a85ed6-752d-4a0f-8d05-568aac49977f req-e9f51ddc-48f2-4bcc-b96c-d7e9b339710d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.2393072 May 20 20:30:37.519962 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:37.542821 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d9511800-1fa9-4218-a786-157d8ae7d82c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:37.552613 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8be5d189-5a62-4f11-8908-3833ca76d63e {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:30:37.573842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8be5d189-5a62-4f11-8908-3833ca76d63e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8be5d189-5a62-4f11-8908-3833ca76d63e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:37.580537 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:37.584897 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:37.659891 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8be5d189-5a62-4f11-8908-3833ca76d63e,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:37.668759 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.669230 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.669567 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.669890 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.670232 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.670634 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.670859 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.671172 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.671517 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.671910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.672227 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.672539 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:37.678327 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:37.707535 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-78a85ed6-752d-4a0f-8d05-568aac49977f req-bc6966c1-f255-4e3d-b7f1-a81c8c41a981 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1369853 May 20 20:30:37.714588 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c34bc2-0ce8-403d-a7f4-9c137407ceef req-d5244dcd-8e3c-4784-ab5f-536643e08c28 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:37.716128 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d4c34bc2-0ce8-403d-a7f4-9c137407ceef req-d5244dcd-8e3c-4784-ab5f-536643e08c28 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1005685 May 20 20:30:37.767647 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d4c34bc2-0ce8-403d-a7f4-9c137407ceef req-393bd152-5263-4fa2-bce3-d7b4593f9a59 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455716 May 20 20:30:37.948408 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a6e116-b41a-474c-a035-4edc20ac73c7 req-e87ab1af-b917-4c29-b966-dddded82d712 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:37.949938 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-33a6e116-b41a-474c-a035-4edc20ac73c7 req-e87ab1af-b917-4c29-b966-dddded82d712 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1146400 May 20 20:30:37.980382 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:38.012988 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-33a6e116-b41a-474c-a035-4edc20ac73c7 req-29c651bf-2179-4cf6-8aa9-0d225e235654 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567112 May 20 20:30:38.077539 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:38.267398 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:38.295167 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:38.300745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:38.304562 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b38caf57-e138-42b5-b380-adf6eab8f421 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:38.401110 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['8be5d189-5a62-4f11-8908-3833ca76d63e'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:30:38.412365 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'Port': ['ID=080bba6c-30e4-43d8-a64f-1ffc4b054de9,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:38.417413 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:38.426276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:38.640302 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Floating IP dea3a238-b599-4224-b9ac-ece75c719b28 associated. External IP: 172.27.3.145, port: 0d67a0d3-7c10-49ac-89c0-e4f771176280. May 20 20:30:38.713469 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3369fb3c-9af0-4940-84bd-ee24fde01b10 req-87b88850-241e-4c84-ab2c-dc4e458bfc08 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:38.715060 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3369fb3c-9af0-4940-84bd-ee24fde01b10 req-87b88850-241e-4c84-ab2c-dc4e458bfc08 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 945 time: 0.0938523 May 20 20:30:38.769187 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3369fb3c-9af0-4940-84bd-ee24fde01b10 req-007de803-137b-48db-91ac-a84afb88e438 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446827 May 20 20:30:38.989528 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63465016-3ee8-4081-aff3-af92d45d41e1 req-9faf1fe9-e3e5-4f0d-8b25-c9fef7f9faf8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:38.991167 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-63465016-3ee8-4081-aff3-af92d45d41e1 req-9faf1fe9-e3e5-4f0d-8b25-c9fef7f9faf8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1024671 May 20 20:30:39.044265 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-63465016-3ee8-4081-aff3-af92d45d41e1 req-75d763bb-309e-4ce5-aec5-6cc177b08d31 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439727 May 20 20:30:39.119175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225637f7-4bf2-4e00-8acd-5a886b281f2d req-6e643313-92c4-4313-8de2-9a4b8345b6db tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:39.126210 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-225637f7-4bf2-4e00-8acd-5a886b281f2d req-6e643313-92c4-4313-8de2-9a4b8345b6db tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.2174125 May 20 20:30:39.253139 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f90bcde-2591-411d-bb09-9ec8da60773a req-e1edd7bf-1657-4d80-950e-500bb18ca2d0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:39.254657 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8f90bcde-2591-411d-bb09-9ec8da60773a req-e1edd7bf-1657-4d80-950e-500bb18ca2d0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1035774 May 20 20:30:39.256689 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-225637f7-4bf2-4e00-8acd-5a886b281f2d req-84b78d82-655e-42b3-aeb5-f25001b50713 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1296456 May 20 20:30:39.268384 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Router 9e724689-d805-445f-92ab-29fb6d9724fc has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:30:39.316421 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8f90bcde-2591-411d-bb09-9ec8da60773a req-0c133ab8-ae51-4539-99ba-4f32e1143152 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528400 May 20 20:30:39.456946 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:30:39.467931 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] Sync routers for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:30:39.480543 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:30:39.481151 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:30:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:39.483680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:39.545582 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.9265385 May 20 20:30:39.545582 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:39.546177 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 40462) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:39.556301 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2030092252', 'description': 'tempest-secgroup-smoke-2030092252 description', 'project_id': '7c0b04802f8b42819b613e195b66efb7'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:39.562342 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:39.574786 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:39.586648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:39.594593 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'status': 'completed', 'code': 200} May 20 20:30:39.614498 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:39.620401 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:39.623909 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:39.630105 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:39.710789 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-a9f97eac-70fd-4472-b87c-19ddb98230ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:39.713685 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-a9f97eac-70fd-4472-b87c-19ddb98230ba service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1098 time: 0.0810592 May 20 20:30:39.722057 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:39.729486 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:39.736494 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4a63d1fd-f92a-45cc-b37c-50515ce39d56 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:39.736670 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:30:39.787049 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ba6afe29-4227-4612-ab4e-56eb5a2d6275,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:39.797556 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.798182 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.798759 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.799477 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.800086 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.800663 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.802259 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.802856 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.803420 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.804014 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.804590 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.805343 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:30:39.820923 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:39.826175 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2788785 May 20 20:30:39.827581 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:39.828405 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 40470) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:39.833825 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'security_group_rule': {'security_group_id': 'ba6afe29-4227-4612-ab4e-56eb5a2d6275', 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:39.841351 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:39.845697 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:39.849584 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:39.860152 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:39.907998 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:39.911824 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:39.913695 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-0120f8c0-476b-4671-8304-c0a0c7fd0491 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:39.915381 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-0120f8c0-476b-4671-8304-c0a0c7fd0491 service neutron] 10.222.0.69 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 915 time: 0.1885333 May 20 20:30:40.051299 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-43b082cc-95e1-4c72-9399-57fec8ed0d43 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 999 time: 0.1182759 May 20 20:30:40.109683 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.123940 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.158730 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:40.173541 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-7e3fb55d-a58b-4ad6-82d0-e14d80d0164f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:40.175039 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-7e3fb55d-a58b-4ad6-82d0-e14d80d0164f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 200 len: 853 time: 0.0815613 May 20 20:30:40.175862 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'dea3a238-b599-4224-b9ac-ece75c719b28', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'floating_ip_address': '172.27.3.145', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'port_id': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'mac_address': 'fa:16:3e:73:77:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:30:37Z', 'updated_at': '2021-05-20T20:30:37Z', 'revision_number': 0, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 5, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:40.180214 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] Checking router: 9e724689-d805-445f-92ab-29fb6d9724fc for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:30:40.180760 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.182117 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3525181 May 20 20:30:40.184937 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40476) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:40.190574 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'security_group_rule': {'security_group_id': 'ba6afe29-4227-4612-ab4e-56eb5a2d6275', 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:40.193349 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:30:40.194064 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:30:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:40.206870 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:40.217465 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07af08a7-0d3a-4143-b688-f3d6add97978 req-921d631a-8984-47f7-bd86-3861c234a221 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:40.218989 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-07af08a7-0d3a-4143-b688-f3d6add97978 req-921d631a-8984-47f7-bd86-3861c234a221 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 945 time: 0.2359800 May 20 20:30:40.219917 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ee0046f-08ec-45a3-90d4-cddf075a2052,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:40.233257 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0db0cb23-734b-4b1b-ad1f-bc6171822ce0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:40.265668 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:40.292374 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-07af08a7-0d3a-4143-b688-f3d6add97978 req-efeaa340-a5f1-4879-9fbf-7e33df6ab6d3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575800 May 20 20:30:40.309604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:40.324509 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:40.370552 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.448966 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:30:40.455741 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57677012-120f-418e-a9e4-31e9bf88ed95 req-cd52598a-dfc6-4851-b91d-eafec09cd6ac tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:40.460265 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-57677012-120f-418e-a9e4-31e9bf88ed95 req-cd52598a-dfc6-4851-b91d-eafec09cd6ac tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.2026863 May 20 20:30:40.464340 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-a8f70320-a6e3-4c1a-8cbf-a3ca944a52a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:40.465801 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-a8f70320-a6e3-4c1a-8cbf-a3ca944a52a7 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.2604041 May 20 20:30:40.541942 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.550147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c6bc39-b0be-478d-a6f3-2e6bb78658d0 req-88d68acb-8cc5-4c43-b77d-58fa93305e38 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:40.552120 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f1c6bc39-b0be-478d-a6f3-2e6bb78658d0 req-88d68acb-8cc5-4c43-b77d-58fa93305e38 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1196439 May 20 20:30:40.610994 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.615035 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f1c6bc39-b0be-478d-a6f3-2e6bb78658d0 req-1dad014e-f1c5-4115-a171-c7bb9153a430 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522239 May 20 20:30:40.630682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-95c891c9-9a29-4610-b81b-a84cac2b35f2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:40.657108 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-57677012-120f-418e-a9e4-31e9bf88ed95 req-1f39358f-099d-4547-9a50-55bf1216edd3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1899955 May 20 20:30:40.684154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=edfeb97c-6d51-4d30-8c7a-9f58684f3404,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:40.690096 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:40.714704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.718898 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 40484) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:40.719049 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5329702 May 20 20:30:40.724256 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-c4ce46e0-e9ce-4297-930a-0c5d0d43936c service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2389205 May 20 20:30:40.725965 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'security_group_rule': {'security_group_id': 'ba6afe29-4227-4612-ab4e-56eb5a2d6275', 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:40.732424 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:40.740189 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:40.745173 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:40.756712 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:40.850442 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.931353 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b8eafc-eb4e-45b4-9d85-515398363b05 req-e118171a-eba6-48fd-8241-1359cbc6a20f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:40.933198 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-28b8eafc-eb4e-45b4-9d85-515398363b05 req-e118171a-eba6-48fd-8241-1359cbc6a20f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1781523 May 20 20:30:40.935196 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'dea3a238-b599-4224-b9ac-ece75c719b28', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'floating_ip_address': '172.27.3.145', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'port_id': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'mac_address': 'fa:16:3e:73:77:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:30:37Z', 'updated_at': '2021-05-20T20:30:37Z', 'revision_number': 0, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 5, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:30:40.942614 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6461e6f-b56c-48a5-a2ae-74bcddd8270c None None] The sync data for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi is: [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'dea3a238-b599-4224-b9ac-ece75c719b28', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'floating_ip_address': '172.27.3.145', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'port_id': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'mac_address': 'fa:16:3e:73:77:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:30:37Z', 'updated_at': '2021-05-20T20:30:37Z', 'revision_number': 0, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 5, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:30:40.983525 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:40.991861 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.000963 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d253a40b-8166-4349-a682-089ff9c6fdb3 req-adc93ad0-9dfb-4205-a32e-6617a96b41e9 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2631657 May 20 20:30:41.008309 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7535f91b-b4d7-4ec6-a926-15f09a927877 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:41.050239 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d7115792-8ac1-491e-b1ea-43b2df983ad0,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:41.059522 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:41.062870 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-28b8eafc-eb4e-45b4-9d85-515398363b05 req-11c652a6-3af5-4982-8421-ee72f38aadc7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065834 May 20 20:30:41.063682 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.066014 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-d0cd6a7b-f537-4a82-938c-3fe9137ea266 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3442614 May 20 20:30:41.067607 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40488) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:41.073898 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'security_group_rule': {'security_group_id': 'ba6afe29-4227-4612-ab4e-56eb5a2d6275', 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:41.082696 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:41.087740 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:41.090838 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:41.098039 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:41.116074 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.186725 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.191142 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.197808 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fe0d87ed-462c-4cbc-b10a-11f927586d6d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:41.210553 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6329ad5-ef66-4c9e-93c3-4c3615c33ac9 None None] New status for floating IP dea3a238-b599-4224-b9ac-ece75c719b28: ACTIVE {{(pid=91647) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:30:41.218212 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=13fcfdce-aa26-4f88-987e-6cbcaf99fc7d,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:41.222551 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:41.234409 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.235532 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-3557084f-06b1-4e24-966b-072a383cca4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1668360 May 20 20:30:41.238355 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40492) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:41.243746 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'security_group_rule': {'security_group_id': 'ba6afe29-4227-4612-ab4e-56eb5a2d6275', 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:41.251121 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:41.255048 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:41.258120 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:41.264470 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:41.275167 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.securitygroups_db [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Project 7c0b04802f8b42819b613e195b66efb7 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 20 20:30:41.281160 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.302117 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8be5d189-5a62-4f11-8908-3833ca76d63e up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:30:41.374631 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.380244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.382634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:41.409174 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36d7c09a-1a93-4d42-b3ac-c218eed5cb8e,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:41.413143 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:41.422877 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.424398 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6163d359-a50c-4df6-bd64-f4e99db6b536 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1851437 May 20 20:30:41.427409 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 40498) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:30:41.434284 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'security_group_rule': {'security_group_id': 'ba6afe29-4227-4612-ab4e-56eb5a2d6275', 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:41.442097 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:30:41.447608 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Usage tracker for resource:security_group_rule and tenant:7c0b04802f8b42819b613e195b66efb7 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:30:41.451084 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:30:41.505527 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 8be5d189-5a62-4f11-8908-3833ca76d63e completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:30:41.533777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df43e766-4fad-4a6c-ad50-aa7f8ae67559 req-4d3f3e7c-c2ea-436c-9ac1-cb181ad20af8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:41.535408 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-df43e766-4fad-4a6c-ad50-aa7f8ae67559 req-4d3f3e7c-c2ea-436c-9ac1-cb181ad20af8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 945 time: 0.1097741 May 20 20:30:41.550067 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:30:41.561835 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.securitygroups_db [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Project 7c0b04802f8b42819b613e195b66efb7 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 20 20:30:41.568324 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.569919 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 8be5d189-5a62-4f11-8908-3833ca76d63e triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:30:41.570296 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.604134 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-df43e766-4fad-4a6c-ad50-aa7f8ae67559 req-7cd5664f-1778-4b8f-9ff7-0d9f1e32f5fa tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611324 May 20 20:30:41.662951 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.670326 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.673593 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-49e13e99-e01a-4a0c-a5d9-706b59c40f89 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:41.713505 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=21b3e2dd-884f-4a62-860e-7488465fb51e,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:41.718599 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:41.733420 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.737789 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3062801 May 20 20:30:41.738726 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.774770 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8be5d189-5a62-4f11-8908-3833ca76d63e'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:41.791517 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8be5d189-5a62-4f11-8908-3833ca76d63e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8be5d189-5a62-4f11-8908-3833ca76d63e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:41.797352 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:41.801219 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-5b30dc75-56bc-4ace-a9b4-c9798c3ecb83 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:41.877141 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f42c95-0534-485a-a5b4-b45b127c9022 req-6156690c-3b93-44f8-a713-1328288dddff tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:41.880963 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8be5d189-5a62-4f11-8908-3833ca76d63e,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:41.886427 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:41.891487 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-42f42c95-0534-485a-a5b4-b45b127c9022 req-6156690c-3b93-44f8-a713-1328288dddff tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1096475 May 20 20:30:41.902990 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c22eb8a-be8c-4f03-a301-f73116f25e52 req-3dc4b7b6-d320-4748-b3a9-ad4a42fbcbce tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:41.904682 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9c22eb8a-be8c-4f03-a301-f73116f25e52 req-3dc4b7b6-d320-4748-b3a9-ad4a42fbcbce tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1009097 May 20 20:30:41.936608 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-42f42c95-0534-485a-a5b4-b45b127c9022 req-446b57d8-2843-467b-8ae8-18b0edb02fb1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442719 May 20 20:30:41.954457 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9c22eb8a-be8c-4f03-a301-f73116f25e52 req-63e6e304-1b52-4bb4-a720-757eccf8320f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431585 May 20 20:30:42.013248 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8be5d189-5a62-4f11-8908-3833ca76d63e', 'code': 200} May 20 20:30:42.096598 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-c616effe-9e31-49cd-ac94-51248537d22b req-1b6891b3-7d7d-4357-82ea-22b0b431d506 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Synchronizing usage tracker for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:30:42.124369 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-c616effe-9e31-49cd-ac94-51248537d22b req-1b6891b3-7d7d-4357-82ea-22b0b431d506 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Unset dirty status for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:30:42.127422 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c616effe-9e31-49cd-ac94-51248537d22b req-1b6891b3-7d7d-4357-82ea-22b0b431d506 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2030092252&fields=id&tenant_id=7c0b04802f8b42819b613e195b66efb7 HTTP/1.1" status: 200 len: 267 time: 0.0813367 May 20 20:30:42.248855 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c616effe-9e31-49cd-ac94-51248537d22b req-535bf84c-2f25-48a5-8ce5-f0b7600198d4 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:42.250417 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c616effe-9e31-49cd-ac94-51248537d22b req-535bf84c-2f25-48a5-8ce5-f0b7600198d4 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.1149287 May 20 20:30:42.268000 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'port': {'security_groups': ['a280c5d3-c0db-4e96-8163-d76c7fb84fac', 'ba6afe29-4227-4612-ab4e-56eb5a2d6275']}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:30:42.341631 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44e263f-b935-44e3-b3c5-8b4f61ad401c req-4e7be76b-700f-438e-83f6-0b0d5d93419c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:42.343098 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b44e263f-b935-44e3-b3c5-8b4f61ad401c req-4e7be76b-700f-438e-83f6-0b0d5d93419c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1577926 May 20 20:30:42.388903 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35d743c-dbfd-4345-8bd8-3fc9aad20aee req-d808ba6b-4569-4daf-9bd8-a9a3b24b7af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:42.390350 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d35d743c-dbfd-4345-8bd8-3fc9aad20aee req-d808ba6b-4569-4daf-9bd8-a9a3b24b7af6 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 1099 time: 0.1182051 May 20 20:30:42.400320 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:42.406548 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b44e263f-b935-44e3-b3c5-8b4f61ad401c req-5413db7b-ca8a-4b69-ae60-39642b704b6a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546262 May 20 20:30:42.452828 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d35d743c-dbfd-4345-8bd8-3fc9aad20aee req-d844edac-744d-4a07-abaf-46db9ef16c71 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452774 May 20 20:30:42.675090 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:42.704772 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:42.709716 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:42.716572 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:42.734587 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['0d67a0d3-7c10-49ac-89c0-e4f771176280'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:30:42.784436 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:42.785082 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:42.786486 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c616effe-9e31-49cd-ac94-51248537d22b req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "PUT /v2.0/ports/0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 981 time: 0.5259812 May 20 20:30:42.787002 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:42.816638 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=6']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:42.824455 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:42.866660 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79825cf-79fc-4ed6-8600-951e41ee675a req-6b1c60e4-4572-4968-8315-bfb6810e1728 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:42.868892 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a79825cf-79fc-4ed6-8600-951e41ee675a req-6b1c60e4-4572-4968-8315-bfb6810e1728 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.1312850 May 20 20:30:42.928409 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a79825cf-79fc-4ed6-8600-951e41ee675a req-dbc5d414-2cb5-4729-8b25-dbf025e208f7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544789 May 20 20:30:43.020774 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'status': 'completed', 'code': 200} May 20 20:30:43.076189 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1368ec1c-582b-497c-a678-bc89b9c4e619 req-db143ebc-6b37-4fe9-921e-4b66ae817a0b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.084350 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1368ec1c-582b-497c-a678-bc89b9c4e619 req-db143ebc-6b37-4fe9-921e-4b66ae817a0b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.1523485 May 20 20:30:43.145722 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1368ec1c-582b-497c-a678-bc89b9c4e619 req-dc2dd063-e104-4cf3-b4b6-b7336521e22b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0544851 May 20 20:30:43.151148 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-8f830c3d-43f7-4a80-8bf7-2d26e35c4dfd None None] Provisioning complete for port 0d67a0d3-7c10-49ac-89c0-e4f771176280 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:30:43.151528 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8f830c3d-43f7-4a80-8bf7-2d26e35c4dfd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:43.242235 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['0d67a0d3-7c10-49ac-89c0-e4f771176280'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:30:43.249201 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea801778-aa6d-49c9-a64e-b144822afcab req-06ceb583-87f6-45ac-8b86-22ca44de17d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.251066 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea801778-aa6d-49c9-a64e-b144822afcab req-06ceb583-87f6-45ac-8b86-22ca44de17d6 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1137 time: 0.1900167 May 20 20:30:43.265949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de73530-0ecc-4674-8516-bffeaf142fd9 req-38fc0058-d67b-43c9-9495-1e4d104e94b5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.267604 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0de73530-0ecc-4674-8516-bffeaf142fd9 req-38fc0058-d67b-43c9-9495-1e4d104e94b5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1340852 May 20 20:30:43.296610 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:30:43.427862 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0de73530-0ecc-4674-8516-bffeaf142fd9 req-08eecde6-067f-4df3-99e3-68797b1732a6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1390505 May 20 20:30:43.474044 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8d73b8-2b9d-40b5-aca8-ce057d83d96b req-4b3ccadb-6562-4e08-a16e-906cfcb7408c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.480274 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9c8d73b8-2b9d-40b5-aca8-ce057d83d96b req-4b3ccadb-6562-4e08-a16e-906cfcb7408c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1805289 May 20 20:30:43.539436 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea801778-aa6d-49c9-a64e-b144822afcab req-03feb56a-8b9e-43a7-8292-e32bef24f543 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.540924 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea801778-aa6d-49c9-a64e-b144822afcab req-03feb56a-8b9e-43a7-8292-e32bef24f543 service neutron] 10.222.0.69 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 915 time: 0.2721817 May 20 20:30:43.565068 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9c8d73b8-2b9d-40b5-aca8-ce057d83d96b req-e410677d-e0bf-449d-b5fa-d707b3a8e0d0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0791996 May 20 20:30:43.719661 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37da5eac-f772-49e2-ba34-4ba03dfcdaef req-c9017475-355e-41f3-ae8f-eabcfba2e540 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.720845 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37da5eac-f772-49e2-ba34-4ba03dfcdaef req-c9017475-355e-41f3-ae8f-eabcfba2e540 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 1098 time: 0.2680595 May 20 20:30:43.733607 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea801778-aa6d-49c9-a64e-b144822afcab req-d653ca53-1509-455e-acfe-0c7a87a368f0 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 1001 time: 0.1761363 May 20 20:30:43.772554 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:43.807064 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'port_id': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'mac_address': 'fa:16:3e:29:ca:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 840, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:30:43.832188 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37da5eac-f772-49e2-ba34-4ba03dfcdaef req-e4d51d4d-4b5d-4e0f-8f87-90b631177cce service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0975943 May 20 20:30:43.837611 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea801778-aa6d-49c9-a64e-b144822afcab req-88fc128d-19f0-4413-a075-3b9daaa6b62f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.839018 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea801778-aa6d-49c9-a64e-b144822afcab req-88fc128d-19f0-4413-a075-3b9daaa6b62f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 200 len: 853 time: 0.0869548 May 20 20:30:43.849522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f29b0a-a9be-4279-ae72-a43f76b4c2f1 req-208793d7-5f9a-49d8-a375-af775d860339 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:43.850960 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-23f29b0a-a9be-4279-ae72-a43f76b4c2f1 req-208793d7-5f9a-49d8-a375-af775d860339 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.2352557 May 20 20:30:43.896748 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:43.900986 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-23f29b0a-a9be-4279-ae72-a43f76b4c2f1 req-898ac0ea-f31a-4caa-a6cd-28f72e6bbfd1 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411496 May 20 20:30:43.937112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:30:43.973879 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:43.983935 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:43.987996 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c5b64cad-1191-4abf-8b55-a3b8afa5a03d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:44.091750 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=6']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:44.095322 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:44.127806 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea801778-aa6d-49c9-a64e-b144822afcab req-ca038e4f-bad7-4fcd-82ac-cc6df4a37bd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:44.129292 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea801778-aa6d-49c9-a64e-b144822afcab req-ca038e4f-bad7-4fcd-82ac-cc6df4a37bd6 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0972331 May 20 20:30:44.147081 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d0074c-79c6-4b52-ad11-197b03cf3fca req-fd8a04f1-b8e1-4660-9343-2b921451ccc6 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:44.148704 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-36d0074c-79c6-4b52-ad11-197b03cf3fca req-fd8a04f1-b8e1-4660-9343-2b921451ccc6 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.0973766 May 20 20:30:44.203367 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-36d0074c-79c6-4b52-ad11-197b03cf3fca req-75191ed8-e9a3-4230-8cba-9d57de13b3be tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487859 May 20 20:30:44.298847 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea801778-aa6d-49c9-a64e-b144822afcab req-3c7dd728-911e-4f37-a005-fddc3119ea61 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1384301 May 20 20:30:44.530333 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea801778-aa6d-49c9-a64e-b144822afcab req-3ceb4437-4d54-4103-9f2c-1ed39a8afa92 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2058909 May 20 20:30:44.647323 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707f2da2-1b6c-499d-ad8e-2a2863976706 req-686cad5c-0cd7-4462-aa03-e428df4e8644 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:44.651786 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-707f2da2-1b6c-499d-ad8e-2a2863976706 req-686cad5c-0cd7-4462-aa03-e428df4e8644 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.0828247 May 20 20:30:44.708446 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-707f2da2-1b6c-499d-ad8e-2a2863976706 req-f66135d3-1df0-4d99-b633-f6d33cd86f78 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523841 May 20 20:30:44.764249 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e69f3f-927c-4418-94fb-0d6f057ad7eb req-92905035-064c-4b39-b8ea-3ea800c354cb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:44.765676 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e69f3f-927c-4418-94fb-0d6f057ad7eb req-92905035-064c-4b39-b8ea-3ea800c354cb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0887756 May 20 20:30:44.812503 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e69f3f-927c-4418-94fb-0d6f057ad7eb req-01f23d3b-97a9-42b4-a29d-578203614cad tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410302 May 20 20:30:44.852928 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:30:44.995993 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:45.106144 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0622e582-4852-4921-8dbc-9c99e37c5c5f req-8f5d5eea-80cf-47cb-967c-7b438de533f7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:45.107892 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0622e582-4852-4921-8dbc-9c99e37c5c5f req-8f5d5eea-80cf-47cb-967c-7b438de533f7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0925317 May 20 20:30:45.154812 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0622e582-4852-4921-8dbc-9c99e37c5c5f req-5ae23b72-270d-4b3e-8a89-c40d58589126 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413053 May 20 20:30:45.393266 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ddac8cf-0cda-4d9a-9e21-1798f07e8e7a req-1c6a1a77-8561-4007-95a6-85762803fab2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:45.394717 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ddac8cf-0cda-4d9a-9e21-1798f07e8e7a req-1c6a1a77-8561-4007-95a6-85762803fab2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.0812216 May 20 20:30:45.462235 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ddac8cf-0cda-4d9a-9e21-1798f07e8e7a req-0dbf0c68-3498-4e52-bedd-fb22dd0fdf30 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598261 May 20 20:30:45.905286 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e279497-12db-4e0f-8e37-db8244b4a7f1 req-bcd0702c-0ee5-494a-9472-ad7a36d77807 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:45.906936 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1e279497-12db-4e0f-8e37-db8244b4a7f1 req-bcd0702c-0ee5-494a-9472-ad7a36d77807 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.0880949 May 20 20:30:45.969353 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1e279497-12db-4e0f-8e37-db8244b4a7f1 req-85df2b93-ceea-4817-8854-d56693d4d537 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530405 May 20 20:30:46.080046 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79f9d64e-4526-4752-9c05-a59a0716183e req-6166fdde-5201-4025-9b7d-477ddc48c1e2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:46.081638 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-79f9d64e-4526-4752-9c05-a59a0716183e req-6166fdde-5201-4025-9b7d-477ddc48c1e2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1028130 May 20 20:30:46.143739 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-79f9d64e-4526-4752-9c05-a59a0716183e req-f174b77f-4b7f-4bdb-9feb-297ff1a68f36 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550265 May 20 20:30:46.380244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd59fda-ef3b-4b88-8cea-044b9ad5711e req-0f183343-ef73-49d0-b361-456925f3080f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:46.381799 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dbd59fda-ef3b-4b88-8cea-044b9ad5711e req-0f183343-ef73-49d0-b361-456925f3080f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1112170 May 20 20:30:46.432798 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dbd59fda-ef3b-4b88-8cea-044b9ad5711e req-74b50143-72a4-4e15-9b75-46795ff7c121 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440123 May 20 20:30:46.678076 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87414a4-915b-4882-8efe-4085c9be8589 req-6cdf3d81-69ea-4094-be65-478810d4712f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:46.685998 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b87414a4-915b-4882-8efe-4085c9be8589 req-6cdf3d81-69ea-4094-be65-478810d4712f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.1063416 May 20 20:30:46.729900 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b87414a4-915b-4882-8efe-4085c9be8589 req-16dd509b-1c57-4bfb-ad40-db3987c77e84 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430536 May 20 20:30:47.325879 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:30:47.376404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39ae5fa6-1a7b-43e1-af8a-f435de7b174a req-718b5f7c-baa9-45a0-bf47-c08ff0077dc0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:47.378024 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-39ae5fa6-1a7b-43e1-af8a-f435de7b174a req-718b5f7c-baa9-45a0-bf47-c08ff0077dc0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.1547565 May 20 20:30:47.428501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:30:47.428907 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:47.440669 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-39ae5fa6-1a7b-43e1-af8a-f435de7b174a req-fb277031-85a2-447e-b610-afca07479df3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0551879 May 20 20:30:47.483408 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe3674f5-3b5d-4b1b-9d89-5320eac36d95 req-ff586e32-e8c3-43c6-952f-28b928d07345 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:47.493544 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fe3674f5-3b5d-4b1b-9d89-5320eac36d95 req-ff586e32-e8c3-43c6-952f-28b928d07345 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1225305 May 20 20:30:47.557989 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fe3674f5-3b5d-4b1b-9d89-5320eac36d95 req-c21d8516-bd42-4374-8fd1-371a7275d392 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0629866 May 20 20:30:47.637684 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:47.673057 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:30:47.685243 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:30:47.690703 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ad44c2-b41a-471d-a4ff-6001618ff891 req-263d3105-4224-49dc-befe-6ed6180b1813 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:47.692861 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-78ad44c2-b41a-471d-a4ff-6001618ff891 req-263d3105-4224-49dc-befe-6ed6180b1813 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1046314 May 20 20:30:47.693001 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:30:47.696512 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:30:47.738771 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'code': 200} May 20 20:30:47.745672 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-78ad44c2-b41a-471d-a4ff-6001618ff891 req-574cccb0-afeb-4f48-bf8e-39ff615de35f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446870 May 20 20:30:47.786024 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=7']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:30:47.789606 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:30:48.794138 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99771292-2094-4999-b9c2-ac774d868d26 req-fbc03144-37dd-4cd8-9c11-cb2de2c4c122 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:48.801307 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-99771292-2094-4999-b9c2-ac774d868d26 req-fbc03144-37dd-4cd8-9c11-cb2de2c4c122 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1242683 May 20 20:30:48.849139 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-99771292-2094-4999-b9c2-ac774d868d26 req-675b3ade-c3bb-4920-97dd-ad4782e855f7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458610 May 20 20:30:49.069745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c9c366-de36-408b-9f84-bded13f38352 req-e3ada5b4-ef56-47f0-8842-3c5b48e133f0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:49.072743 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-64c9c366-de36-408b-9f84-bded13f38352 req-e3ada5b4-ef56-47f0-8842-3c5b48e133f0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1096563 May 20 20:30:49.139413 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-64c9c366-de36-408b-9f84-bded13f38352 req-c2371f6c-5c7b-40fa-98e7-74daff6c5a8b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594611 May 20 20:30:49.335410 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c32c95-eeaa-4bf9-952d-f94d4ecb058f req-8e8db756-29fe-42b3-b605-9ef5a84c22ef tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:49.344774 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-80c32c95-eeaa-4bf9-952d-f94d4ecb058f req-8e8db756-29fe-42b3-b605-9ef5a84c22ef tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.1320429 May 20 20:30:49.396320 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-80c32c95-eeaa-4bf9-952d-f94d4ecb058f req-6495b12d-b24d-4356-81d7-721ddcd36636 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504341 May 20 20:30:49.620510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01b5c2c-2471-4112-9053-7ec7c50f5f45 req-666a0381-83c3-4d88-b546-93fc09003210 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:49.622241 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a01b5c2c-2471-4112-9053-7ec7c50f5f45 req-666a0381-83c3-4d88-b546-93fc09003210 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1065593 May 20 20:30:49.688814 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a01b5c2c-2471-4112-9053-7ec7c50f5f45 req-71bfaa6f-9df5-4be6-9925-bcda5fe459b4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598276 May 20 20:30:50.097038 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6e4fb4-a019-4e77-a3ef-bc418497f4f2 req-8d7b941b-c307-4588-aea7-2a2c9b35dcb8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:50.098920 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ed6e4fb4-a019-4e77-a3ef-bc418497f4f2 req-8d7b941b-c307-4588-aea7-2a2c9b35dcb8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1060088 May 20 20:30:50.288183 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ed6e4fb4-a019-4e77-a3ef-bc418497f4f2 req-baf25ef3-66c0-422e-935e-c6b7b0f70af2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1827559 May 20 20:30:50.379852 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8b7f12-2fd0-4051-bee9-87de213238f6 req-9df3aefc-6ee1-4516-a104-79f4f7193c9a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:50.381470 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1a8b7f12-2fd0-4051-bee9-87de213238f6 req-9df3aefc-6ee1-4516-a104-79f4f7193c9a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1098044 May 20 20:30:50.436340 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1a8b7f12-2fd0-4051-bee9-87de213238f6 req-0c440c95-ff7d-4f95-baa4-8d961e6269d9 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482726 May 20 20:30:51.533889 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb0ff3-8137-4250-bb10-ebcd3a6f778d req-206736f5-74c1-42fe-a243-9513c5ed4d60 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:51.536396 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-45bb0ff3-8137-4250-bb10-ebcd3a6f778d req-206736f5-74c1-42fe-a243-9513c5ed4d60 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1139107 May 20 20:30:51.603176 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-45bb0ff3-8137-4250-bb10-ebcd3a6f778d req-72e363a1-3dc5-46e3-9ecf-e623f14dc68e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0583510 May 20 20:30:51.840663 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca3f9d5a-c5b7-464d-8d6c-e55a34f5a4d6 req-18fda798-1a7b-446f-a147-007336d322a2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:51.842081 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ca3f9d5a-c5b7-464d-8d6c-e55a34f5a4d6 req-18fda798-1a7b-446f-a147-007336d322a2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1209488 May 20 20:30:51.902377 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ca3f9d5a-c5b7-464d-8d6c-e55a34f5a4d6 req-d23ddbed-06ff-4524-b5f5-adb31994cff3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519459 May 20 20:30:51.974395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30abe78-6815-4df9-84f0-4ccd49306bf9 req-72a61d97-7736-48f6-85e2-b4c77ea78281 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:51.975858 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c30abe78-6815-4df9-84f0-4ccd49306bf9 req-72a61d97-7736-48f6-85e2-b4c77ea78281 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1208694 May 20 20:30:52.001148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6add6c7-2942-438a-bc33-925420257659 req-e23f0ec2-62a6-4f70-a623-af5b12c17699 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:52.002646 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6add6c7-2942-438a-bc33-925420257659 req-e23f0ec2-62a6-4f70-a623-af5b12c17699 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1098 time: 0.1960599 May 20 20:30:52.034598 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c30abe78-6815-4df9-84f0-4ccd49306bf9 req-f5268a83-ef01-46eb-a78f-b7ec7e6589ce tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502701 May 20 20:30:52.209587 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6add6c7-2942-438a-bc33-925420257659 req-9dd53cbf-146c-4546-98eb-9d270fa5125a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:52.211125 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6add6c7-2942-438a-bc33-925420257659 req-9dd53cbf-146c-4546-98eb-9d270fa5125a service neutron] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 919 time: 0.1755650 May 20 20:30:52.305664 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6add6c7-2942-438a-bc33-925420257659 req-eee85f11-6ccf-4335-a74c-cfb492527a68 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 200 len: 217 time: 0.0760596 May 20 20:30:52.381903 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6add6c7-2942-438a-bc33-925420257659 req-e2fd2004-8275-4791-a9c7-e6dfe04f2932 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:52.383644 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6add6c7-2942-438a-bc33-925420257659 req-e2fd2004-8275-4791-a9c7-e6dfe04f2932 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.0618951 May 20 20:30:52.545154 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6add6c7-2942-438a-bc33-925420257659 req-fd884fe2-91a3-49a3-bbe1-2ec1e253b9fa service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1227548 May 20 20:30:52.747080 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6add6c7-2942-438a-bc33-925420257659 req-4df26414-9fac-4c0b-973c-6dc1d860addf service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1748843 May 20 20:30:52.828927 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab83575f-5f76-4c90-b8c2-133cff75f909 req-672a94b3-832a-412e-b3ff-b5dc9e450e95 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:52.831132 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ab83575f-5f76-4c90-b8c2-133cff75f909 req-672a94b3-832a-412e-b3ff-b5dc9e450e95 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0972891 May 20 20:30:52.886137 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ab83575f-5f76-4c90-b8c2-133cff75f909 req-2c12100c-8f49-417f-b25a-0664a3ae5797 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473485 May 20 20:30:52.921612 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6add6c7-2942-438a-bc33-925420257659 req-e54fc742-60bf-4da8-9ac3-3add7ace1507 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1599088 May 20 20:30:53.196965 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-141588b7-d828-424a-a7e7-5ebead850846 req-f9764db3-e897-48ea-90e8-4d45efec4676 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:53.198491 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-141588b7-d828-424a-a7e7-5ebead850846 req-f9764db3-e897-48ea-90e8-4d45efec4676 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1723533 May 20 20:30:53.268780 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-141588b7-d828-424a-a7e7-5ebead850846 req-18549462-57c8-44fc-beec-8b520c7b44e5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0612950 May 20 20:30:53.322182 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd69343-3011-4eab-bac0-bc803b9d6e72 req-2ded8174-807e-4512-bfa4-29f5b48a98ec tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:53.323698 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ccd69343-3011-4eab-bac0-bc803b9d6e72 req-2ded8174-807e-4512-bfa4-29f5b48a98ec tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1162612 May 20 20:30:53.375385 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ccd69343-3011-4eab-bac0-bc803b9d6e72 req-0e6268e7-f32f-48e7-ae83-0672f989bb6f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456901 May 20 20:30:54.129941 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f05c78-6c9b-41a7-9b1d-58596c0a12c1 req-c2a3d9ee-b025-4c7e-b03b-d69a401f2954 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:54.131632 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-61f05c78-6c9b-41a7-9b1d-58596c0a12c1 req-c2a3d9ee-b025-4c7e-b03b-d69a401f2954 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0864000 May 20 20:30:54.188358 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-61f05c78-6c9b-41a7-9b1d-58596c0a12c1 req-b1deef27-bb03-477b-bb78-6565a6b2d6f2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474453 May 20 20:30:54.541350 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e0a768-6122-4f01-85f5-c9dfd8b4d25c req-25b51237-3d22-483f-888f-2533d2d44d73 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:54.544209 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-63e0a768-6122-4f01-85f5-c9dfd8b4d25c req-25b51237-3d22-483f-888f-2533d2d44d73 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1524827 May 20 20:30:54.615368 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-63e0a768-6122-4f01-85f5-c9dfd8b4d25c req-25380d37-2af1-48dd-9826-d8d1e80af106 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606894 May 20 20:30:54.655135 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b5f7856-a115-442d-a72c-c40ddb222aa2 req-7a7dd5fa-5ae8-41b1-9f04-c906a39cc8ba tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:54.657115 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9b5f7856-a115-442d-a72c-c40ddb222aa2 req-7a7dd5fa-5ae8-41b1-9f04-c906a39cc8ba tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1122496 May 20 20:30:54.721207 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9b5f7856-a115-442d-a72c-c40ddb222aa2 req-5b80fc2d-075f-4d6a-bc2e-47ae13d9cec3 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557971 May 20 20:30:55.404429 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3cc4d9-96da-4eae-9b9d-31320e55b357 req-308c6f83-d103-45ae-910c-fdae58506067 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:55.406387 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fc3cc4d9-96da-4eae-9b9d-31320e55b357 req-308c6f83-d103-45ae-910c-fdae58506067 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0923684 May 20 20:30:55.463793 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fc3cc4d9-96da-4eae-9b9d-31320e55b357 req-996d9331-c1f7-4669-a769-e9962af70d07 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496662 May 20 20:30:55.817600 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7035c540-1284-486c-a007-68c730f95c96 req-af64aed1-3a14-45fd-a8b6-3c6b91672369 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:55.821009 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7035c540-1284-486c-a007-68c730f95c96 req-af64aed1-3a14-45fd-a8b6-3c6b91672369 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0941777 May 20 20:30:55.869191 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7035c540-1284-486c-a007-68c730f95c96 req-02858a07-043f-4ea1-b80f-fa0d3310be96 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432405 May 20 20:30:55.949224 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446bc412-7f87-437e-82be-25435b88a68f req-054b94d2-630d-4d53-989d-a30260da3df3 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:55.950787 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-446bc412-7f87-437e-82be-25435b88a68f req-054b94d2-630d-4d53-989d-a30260da3df3 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1031752 May 20 20:30:56.020306 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-446bc412-7f87-437e-82be-25435b88a68f req-ee56ee4c-adaa-409d-860e-c1a39bade051 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621438 May 20 20:30:56.712944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c69894-a218-403c-9977-5972e9b2bce1 req-bc8be2a1-cc01-4a02-bb92-a4da9b86346c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:56.714714 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20c69894-a218-403c-9977-5972e9b2bce1 req-bc8be2a1-cc01-4a02-bb92-a4da9b86346c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1310320 May 20 20:30:56.762735 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20c69894-a218-403c-9977-5972e9b2bce1 req-3d5ffdb3-2c8b-4e28-9fe6-b8bf0844c09c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421917 May 20 20:30:57.070808 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee90330c-8695-41ef-add7-3331abf4c0ef req-e8f13db9-046d-4baf-a01e-825defa01d11 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:57.072577 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ee90330c-8695-41ef-add7-3331abf4c0ef req-e8f13db9-046d-4baf-a01e-825defa01d11 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0866835 May 20 20:30:57.120215 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ee90330c-8695-41ef-add7-3331abf4c0ef req-5e05c61a-6d76-4a8c-b0f8-957871cc6ffa tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405045 May 20 20:30:57.230131 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7df5b22-bad0-4124-aa91-30cbd8357ffa req-2426a253-877a-48e8-9369-daaeca26cac0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:57.231598 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e7df5b22-bad0-4124-aa91-30cbd8357ffa req-2426a253-877a-48e8-9369-daaeca26cac0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0815918 May 20 20:30:57.276615 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e7df5b22-bad0-4124-aa91-30cbd8357ffa req-6eb6e025-c74a-4008-b3f6-8e770a5435b7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392277 May 20 20:30:57.954156 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42407e29-047a-4c86-bba9-987e6c75ad50 req-af449f29-261b-4678-900f-2276d16538d3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:57.955523 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-42407e29-047a-4c86-bba9-987e6c75ad50 req-af449f29-261b-4678-900f-2276d16538d3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0796361 May 20 20:30:58.001171 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-42407e29-047a-4c86-bba9-987e6c75ad50 req-c3a3f648-fc53-4454-9106-8fe090a2808d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389915 May 20 20:30:58.313890 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951bbc19-ec1c-4adb-8d40-54036e9ca17a req-8e57f127-4500-426b-987d-15d424a3122a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:58.315345 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-951bbc19-ec1c-4adb-8d40-54036e9ca17a req-8e57f127-4500-426b-987d-15d424a3122a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0828137 May 20 20:30:58.359940 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-951bbc19-ec1c-4adb-8d40-54036e9ca17a req-ee791ff4-8cd0-4732-b4e3-76442fb8919b tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379555 May 20 20:30:58.468412 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f77d58cc-bb8d-4e47-8629-3be5c6b2d8c0 req-0aa6c00a-f0ca-4f09-a678-a38b1643eec0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:58.469839 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f77d58cc-bb8d-4e47-8629-3be5c6b2d8c0 req-0aa6c00a-f0ca-4f09-a678-a38b1643eec0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0870488 May 20 20:30:58.516412 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f77d58cc-bb8d-4e47-8629-3be5c6b2d8c0 req-0433dd28-0a07-4129-9db5-16af783834ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407057 May 20 20:30:58.519394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-6fc5956e-5bfe-4322-a0b7-e6e12096b242 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:58.520774 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-6fc5956e-5bfe-4322-a0b7-e6e12096b242 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1098 time: 0.0760355 May 20 20:30:58.664676 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-9852ce05-e561-4bfa-a078-f1f262a57fe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:58.666087 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-9852ce05-e561-4bfa-a078-f1f262a57fe8 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1274514 May 20 20:30:58.774539 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-3a4b1b7a-3641-4b53-9000-3fb1fe250db8 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 1000 time: 0.0971103 May 20 20:30:58.870352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-4019c386-7b48-417e-a349-80179b84bf77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:58.871988 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-4019c386-7b48-417e-a349-80179b84bf77 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0605237 May 20 20:30:58.972390 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-11a4371c-af03-44a6-9984-80764b54a8b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:58.973852 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-11a4371c-af03-44a6-9984-80764b54a8b8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0717173 May 20 20:30:59.261346 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-2efe65a0-49f3-4222-8325-dbcc7f97e8ea service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2503529 May 20 20:30:59.287816 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e70dafe-47f5-4f0c-b2a4-9b17c821caf3 req-ee061064-81d1-487d-892d-b59c0783d28c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:59.289755 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5e70dafe-47f5-4f0c-b2a4-9b17c821caf3 req-ee061064-81d1-487d-892d-b59c0783d28c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.1744223 May 20 20:30:59.422766 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5e70dafe-47f5-4f0c-b2a4-9b17c821caf3 req-3d9b36e8-38d1-4df4-adef-349ba66285e1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1120255 May 20 20:30:59.455987 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0995bb91-82f5-424c-b11e-b5502f8a9a91 req-cb196a33-945f-4576-a23f-b95835acbb22 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1624265 May 20 20:30:59.557772 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba54335-3a89-4786-9837-9d30f5344d0f req-74a67a4e-faba-4752-b8f8-2e7da258fead tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:59.559243 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0ba54335-3a89-4786-9837-9d30f5344d0f req-74a67a4e-faba-4752-b8f8-2e7da258fead tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0815289 May 20 20:30:59.608338 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0ba54335-3a89-4786-9837-9d30f5344d0f req-3c450493-3aa3-413c-b313-550f57983518 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433962 May 20 20:30:59.783665 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1ceb61-1037-4290-8939-f255a6f4b277 req-15efded5-1079-42e8-b0dc-fc067851dec5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:30:59.785132 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c1ceb61-1037-4290-8939-f255a6f4b277 req-15efded5-1079-42e8-b0dc-fc067851dec5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0802832 May 20 20:30:59.830305 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c1ceb61-1037-4290-8939-f255a6f4b277 req-493ebd5f-0c9f-4df7-b6ac-e23b567d80b6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390446 May 20 20:31:00.629571 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30473beb-cc6a-4a8b-a627-2b7ef9678b81 req-ae5d9a81-bd49-4bb8-8e65-677233cfbf38 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:00.631023 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-30473beb-cc6a-4a8b-a627-2b7ef9678b81 req-ae5d9a81-bd49-4bb8-8e65-677233cfbf38 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 945 time: 0.0824804 May 20 20:31:00.677092 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-30473beb-cc6a-4a8b-a627-2b7ef9678b81 req-4c173c58-30e9-49da-aebb-236990fcb217 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397954 May 20 20:31:00.799565 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb18121-9a18-4546-aac1-0b706b2ef506 req-bde46f00-ed01-4186-bf10-f47cf528d1a5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:00.800921 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bfb18121-9a18-4546-aac1-0b706b2ef506 req-bde46f00-ed01-4186-bf10-f47cf528d1a5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0825844 May 20 20:31:00.848250 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bfb18121-9a18-4546-aac1-0b706b2ef506 req-79c45549-9c3b-4d1d-9cc4-f84f10c41c51 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416348 May 20 20:31:01.025208 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39724ef-5209-4bde-84d6-caefc507b211 req-8bcb006d-7aa1-44a2-879a-e4d9be93bf7c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:01.026715 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e39724ef-5209-4bde-84d6-caefc507b211 req-8bcb006d-7aa1-44a2-879a-e4d9be93bf7c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0832548 May 20 20:31:01.073708 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e39724ef-5209-4bde-84d6-caefc507b211 req-ea9780df-4495-4868-9c99-e4eed948b130 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409906 May 20 20:31:01.396790 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:31:01.513980 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:01.539933 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:31:01.550257 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:01.554213 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:01.556688 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:01.590512 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'code': 200} May 20 20:31:01.621742 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=8']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:01.624831 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:01.868670 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a074bee-17bc-4fa8-85a7-4cbfbe6e0cb6 req-b5131f11-049a-4168-9e81-335cf2cb8e15 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:01.870134 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2a074bee-17bc-4fa8-85a7-4cbfbe6e0cb6 req-b5131f11-049a-4168-9e81-335cf2cb8e15 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0847101 May 20 20:31:01.919264 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2a074bee-17bc-4fa8-85a7-4cbfbe6e0cb6 req-dfde8a9f-d5d0-4fc9-be66-8df6edf9d5a9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432553 May 20 20:31:02.045955 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb43ee2-3515-46e6-ade5-8504c2309941 req-40799b8a-e7d0-424f-a52b-e630ba4e9ff1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:02.047440 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-feb43ee2-3515-46e6-ade5-8504c2309941 req-40799b8a-e7d0-424f-a52b-e630ba4e9ff1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0858667 May 20 20:31:02.094334 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-feb43ee2-3515-46e6-ade5-8504c2309941 req-771b6755-594e-4dcb-9479-aa044cddd29c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408182 May 20 20:31:02.259544 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a04254-f25a-4040-8ce5-1fe8f3eaa8e5 req-33d3a368-c524-43f6-be1d-c5908a5a5cac tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:02.261057 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-13a04254-f25a-4040-8ce5-1fe8f3eaa8e5 req-33d3a368-c524-43f6-be1d-c5908a5a5cac tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0817327 May 20 20:31:02.310203 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-13a04254-f25a-4040-8ce5-1fe8f3eaa8e5 req-e00efb45-0eb2-4c5d-95fd-67609ad8a7cc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434821 May 20 20:31:03.111791 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d7a280-8729-42ea-8c9a-5e9b26f6b0be req-5f4ffd39-0410-4c52-9d78-b7887eb1a6e1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:03.113232 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86d7a280-8729-42ea-8c9a-5e9b26f6b0be req-5f4ffd39-0410-4c52-9d78-b7887eb1a6e1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0824897 May 20 20:31:03.161307 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86d7a280-8729-42ea-8c9a-5e9b26f6b0be req-429a756b-7bf6-4b0c-b074-dbe5101c0967 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412853 May 20 20:31:03.284443 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae33e58-2d20-415d-9045-2b86352908ae req-afe98b6c-b397-4e58-9f23-9e305f8141a6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:03.285869 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5ae33e58-2d20-415d-9045-2b86352908ae req-afe98b6c-b397-4e58-9f23-9e305f8141a6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0778224 May 20 20:31:03.330077 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5ae33e58-2d20-415d-9045-2b86352908ae req-6aa2c174-30f8-418f-bf16-fbd204258fc4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377467 May 20 20:31:03.502270 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8e98430-dfde-4535-9064-2b19b60b023e req-81e05f7e-f697-4abc-b96b-244c1ce45325 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:03.503713 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a8e98430-dfde-4535-9064-2b19b60b023e req-81e05f7e-f697-4abc-b96b-244c1ce45325 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0833540 May 20 20:31:03.552968 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a8e98430-dfde-4535-9064-2b19b60b023e req-4cd880d3-0929-46ab-a152-eedf40e82861 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431850 May 20 20:31:03.746918 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e94cf7c-43eb-46e1-9a05-a2aaf4ce6dcb req-85c7518c-2994-45e9-8ac2-983996c5b3a9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:03.748314 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6e94cf7c-43eb-46e1-9a05-a2aaf4ce6dcb req-85c7518c-2994-45e9-8ac2-983996c5b3a9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.0812554 May 20 20:31:03.794124 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6e94cf7c-43eb-46e1-9a05-a2aaf4ce6dcb req-4bd783ba-3458-41e0-a069-54c16275d685 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397666 May 20 20:31:04.427651 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb62a6bb-29ed-4a3b-b381-152fa5cb61f2 req-fb54784b-d348-4b54-8a18-e4fc9662b9d8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:04.431411 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cb62a6bb-29ed-4a3b-b381-152fa5cb61f2 req-fb54784b-d348-4b54-8a18-e4fc9662b9d8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.1566370 May 20 20:31:04.479360 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cb62a6bb-29ed-4a3b-b381-152fa5cb61f2 req-385f0833-ff18-4cf6-bcfb-a7b2390506c7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439904 May 20 20:31:04.528434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eb38c6e-b913-44eb-a2e3-d551cc1dd0d9 req-c6bc6e0e-d9c1-49ec-a581-1c9c479968a1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:04.529896 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5eb38c6e-b913-44eb-a2e3-d551cc1dd0d9 req-c6bc6e0e-d9c1-49ec-a581-1c9c479968a1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0878575 May 20 20:31:04.574992 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5eb38c6e-b913-44eb-a2e3-d551cc1dd0d9 req-700b9442-d4c4-4c3d-89ed-8e368dd93b8d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393982 May 20 20:31:04.751666 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ad4c144e-fcbe-4219-be92-f16186330083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:04.755490 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3b3630-3c83-4d00-b66f-f28bb86afce6 req-d2ebeb4e-5da7-4da2-a604-a736b487946d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:04.757058 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-bd3b3630-3c83-4d00-b66f-f28bb86afce6 req-d2ebeb4e-5da7-4da2-a604-a736b487946d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0892513 May 20 20:31:04.809072 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-bd3b3630-3c83-4d00-b66f-f28bb86afce6 req-b5474ec9-3e83-4437-99d4-98419e334b40 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449026 May 20 20:31:04.977836 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04d55b9-b1d9-40fa-95ce-59c3a08efb9c req-a71a5681-de96-446e-80ca-64fc3993aaba tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:04.979314 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d04d55b9-b1d9-40fa-95ce-59c3a08efb9c req-a71a5681-de96-446e-80ca-64fc3993aaba tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.0779185 May 20 20:31:05.024618 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d04d55b9-b1d9-40fa-95ce-59c3a08efb9c req-c385ad0c-9b7a-4a0f-bf9a-e956dfb91630 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395637 May 20 20:31:05.671188 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4c9161-84de-476b-a7ac-bb0041367b9d req-e7bd0c5a-dc39-46c4-9c24-dd65b1ab3b6b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:05.672686 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6d4c9161-84de-476b-a7ac-bb0041367b9d req-e7bd0c5a-dc39-46c4-9c24-dd65b1ab3b6b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0803094 May 20 20:31:05.718791 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6d4c9161-84de-476b-a7ac-bb0041367b9d req-a680025b-e4b7-4675-b9c5-b51853e50ec9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403712 May 20 20:31:05.768434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e1496c-8bd2-4ff7-8408-b035e802f07c req-57328e1f-6f39-40ac-80bf-641edbfd17fa tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:05.769853 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6e1496c-8bd2-4ff7-8408-b035e802f07c req-57328e1f-6f39-40ac-80bf-641edbfd17fa tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0850716 May 20 20:31:05.817458 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a6e1496c-8bd2-4ff7-8408-b035e802f07c req-876addcc-fef9-46b9-8735-d9bb797507ea tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413256 May 20 20:31:06.004176 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11938ffc-b2ad-4154-afc3-aa918deffd42 req-ff240902-f94a-401c-9d4b-7d112af269ae tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:06.005645 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-11938ffc-b2ad-4154-afc3-aa918deffd42 req-ff240902-f94a-401c-9d4b-7d112af269ae tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0873184 May 20 20:31:06.053961 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-11938ffc-b2ad-4154-afc3-aa918deffd42 req-e000d277-8ca4-4300-be30-849b90a9840c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407987 May 20 20:31:06.231288 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650182e4-3b7a-42aa-8123-eaa0614abeec req-bfb8fd58-e71a-4b70-ace2-69bffb9b9d91 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:06.233036 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-650182e4-3b7a-42aa-8123-eaa0614abeec req-bfb8fd58-e71a-4b70-ace2-69bffb9b9d91 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.0814888 May 20 20:31:06.279466 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-650182e4-3b7a-42aa-8123-eaa0614abeec req-0cf98f47-4a76-4221-a240-de60ad0d5559 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411234 May 20 20:31:06.629210 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6728542d-07c8-4c6d-9915-0c57116c3f20 req-7462266e-2480-4bad-b8f8-1099917f3a28 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:06.630663 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6728542d-07c8-4c6d-9915-0c57116c3f20 req-7462266e-2480-4bad-b8f8-1099917f3a28 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0853534 May 20 20:31:06.676561 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6728542d-07c8-4c6d-9915-0c57116c3f20 req-41bacaac-22a6-48ed-b304-0051bdcab273 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397403 May 20 20:31:06.972425 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 40816) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:31:07.012198 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc760370-de10-42a1-baf9-67ff8ae85355 req-fa4531b2-17b6-40c8-9450-259321211acb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:07.013708 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dc760370-de10-42a1-baf9-67ff8ae85355 req-fa4531b2-17b6-40c8-9450-259321211acb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0861962 May 20 20:31:07.060567 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dc760370-de10-42a1-baf9-67ff8ae85355 req-7551d5c3-f2b8-463e-a3f7-bed0678f0c6c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410092 May 20 20:31:07.095962 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-39f22d47-f465-44b6-99a8-24a600332107 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1221097 May 20 20:31:07.212634 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:07.265917 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6c9c2d-3176-4c87-8bf1-5a4a3c7828aa req-51eb3ff9-e3a6-4fad-a260-e7c7fcc6cc70 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:07.267408 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b6c9c2d-3176-4c87-8bf1-5a4a3c7828aa req-51eb3ff9-e3a6-4fad-a260-e7c7fcc6cc70 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1008322 May 20 20:31:07.316706 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b6c9c2d-3176-4c87-8bf1-5a4a3c7828aa req-31cd1b33-94f7-47e5-8c3e-90b2cb0068f4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434990 May 20 20:31:07.464204 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36702591-70fa-4f5b-8ac4-afed411b8165 req-62394d43-8783-4b1e-a0ce-e7dc128b163e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:07.465948 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-36702591-70fa-4f5b-8ac4-afed411b8165 req-62394d43-8783-4b1e-a0ce-e7dc128b163e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1086891 May 20 20:31:07.490624 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-48e0802e-b10c-4417-9be8-a7c8529a05fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:07.524988 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-36702591-70fa-4f5b-8ac4-afed411b8165 req-3fe9dbd6-ca4a-4c03-9335-37a1b3e642af tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519311 May 20 20:31:07.587377 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5013d6-795d-49ac-baa5-9e439c516874 req-9821e111-619b-4b02-9b6b-57b96f3030b4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:07.588863 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-de5013d6-795d-49ac-baa5-9e439c516874 req-9821e111-619b-4b02-9b6b-57b96f3030b4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.1548524 May 20 20:31:07.591462 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-8df8c5b0-6959-4f4d-b713-42f6f438e604 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:07.592810 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-8df8c5b0-6959-4f4d-b713-42f6f438e604 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1099 time: 0.1220338 May 20 20:31:07.798239 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-de5013d6-795d-49ac-baa5-9e439c516874 req-8b0cd66f-d138-4b0e-ba68-c6326f363989 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2024598 May 20 20:31:07.800142 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:31:07.843133 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-dcc0ceaf-8ed2-41ae-90de-3685ede4097c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:07.844628 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-dcc0ceaf-8ed2-41ae-90de-3685ede4097c service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.2327771 May 20 20:31:07.875909 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-548ed4d9-1f44-4ce2-82f6-bbf7ac027c89 req-8e8aff30-01f2-411a-8bf6-5c7b950ff5db tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:07.877684 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-548ed4d9-1f44-4ce2-82f6-bbf7ac027c89 req-8e8aff30-01f2-411a-8bf6-5c7b950ff5db tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0835466 May 20 20:31:07.924941 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-548ed4d9-1f44-4ce2-82f6-bbf7ac027c89 req-d58cc323-f6df-4d17-852b-7da5dac001f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405645 May 20 20:31:07.964879 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-40b93fb6-b613-406b-94dc-a2134ba93e15 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 1001 time: 0.0978858 May 20 20:31:08.094497 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-9f634e5a-2d9c-4e09-b40c-a2b868978345 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:08.095957 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-9f634e5a-2d9c-4e09-b40c-a2b868978345 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.1080096 May 20 20:31:08.117934 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-cde12adf-65c4-4884-8bc9-fc23afd55e5e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:08.119275 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-cde12adf-65c4-4884-8bc9-fc23afd55e5e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.1325181 May 20 20:31:08.265336 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:08.289607 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-7a98eff0-4323-46b0-98cc-203f294707b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:08.291051 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-7a98eff0-4323-46b0-98cc-203f294707b0 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1709425 May 20 20:31:08.308208 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Deleting port 8be5d189-5a62-4f11-8908-3833ca76d63e {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:31:08.308567 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:08.552861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] For port 8be5d189-5a62-4f11-8908-3833ca76d63e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8be5d189-5a62-4f11-8908-3833ca76d63e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:08.553235 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:08.566341 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-39f28c37-2678-4a92-9b64-3134509380e3 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2447035 May 20 20:31:08.724617 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f0bf9c3-34d1-4334-b000-3c931ba94a2e req-f1eed09f-7640-4c0e-8706-9e04a57bfde1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:08.726094 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9f0bf9c3-34d1-4334-b000-3c931ba94a2e req-f1eed09f-7640-4c0e-8706-9e04a57bfde1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0842962 May 20 20:31:08.731308 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Calling delete_port for 8be5d189-5a62-4f11-8908-3833ca76d63e owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:31:08.777036 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9f0bf9c3-34d1-4334-b000-3c931ba94a2e req-ff2daff6-7cc0-41b4-8cc0-aa1b1a95a163 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445423 May 20 20:31:08.959670 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9daf60c9-ad7c-4237-a0ae-bcda9241c89d req-b4fccf1a-f4fb-4857-971e-1189c78d4853 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3383901 May 20 20:31:08.976877 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9153b73e-ef49-4ab6-a9e2-0b3738944ce6 req-ed6712f6-80e4-45df-85fa-c13298c00af9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:08.980362 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9153b73e-ef49-4ab6-a9e2-0b3738944ce6 req-ed6712f6-80e4-45df-85fa-c13298c00af9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.3604043 May 20 20:31:09.030047 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ea519b2-5717-4606-b618-dd3c7fda6050 req-3214a3b1-ffbb-41a4-a59b-ab958db8ba5c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:09.031553 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ea519b2-5717-4606-b618-dd3c7fda6050 req-3214a3b1-ffbb-41a4-a59b-ab958db8ba5c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 946 time: 0.1089265 May 20 20:31:09.090495 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ea519b2-5717-4606-b618-dd3c7fda6050 req-76f5c683-a370-430a-b465-a51fc5cc3061 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470114 May 20 20:31:09.100012 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9153b73e-ef49-4ab6-a9e2-0b3738944ce6 req-5bed7ddf-faf0-43c9-80ec-a1e4a56aa67b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099949 May 20 20:31:09.129591 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:09.140624 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:09.157625 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4', '08f701b8-1580-4323-b2f2-c088e14e4e28', '90dacfdb-310f-446a-a389-3184996fd51e', '8be5d189-5a62-4f11-8908-3833ca76d63e'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:31:09.189291 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event deleted for resources: {'Port': ['ID=8be5d189-5a62-4f11-8908-3833ca76d63e,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:09.192557 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:09.351636 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb41739-3b27-4796-aa75-0ad72a54f8fd req-f4fa16fb-9c55-4ef3-bfb0-8966d1e360ca tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:09.354282 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4bb41739-3b27-4796-aa75-0ad72a54f8fd req-f4fa16fb-9c55-4ef3-bfb0-8966d1e360ca tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.1136248 May 20 20:31:09.387593 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] No DVR routers for this DVR port 8be5d189-5a62-4f11-8908-3833ca76d63e on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:31:09.392868 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:09.395538 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'name': 'network-vif-deleted', 'tag': '8be5d189-5a62-4f11-8908-3833ca76d63e'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:31:09.419237 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ef2d9823-2b1a-4916-ba33-c56461b3f63c req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "DELETE /v2.0/ports/8be5d189-5a62-4f11-8908-3833ca76d63e HTTP/1.1" status: 204 len: 173 time: 1.2656040 May 20 20:31:09.420533 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4bb41739-3b27-4796-aa75-0ad72a54f8fd req-9de36e5b-0ac3-4f7f-9f5b-240359f57d7a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582340 May 20 20:31:09.447045 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:31:09.456105 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6fa1dcc0-e314-49ca-b883-12c3e1fbac8e', 'name': 'network-vif-deleted', 'tag': '8be5d189-5a62-4f11-8908-3833ca76d63e', 'status': 'completed', 'code': 200} May 20 20:31:09.896112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:10.105605 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6db2c0-2f9d-4460-bf50-0d881f45c6e4 req-360d69dd-09a0-4d8d-8032-9abefbded6b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.106953 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2e6db2c0-2f9d-4460-bf50-0d881f45c6e4 req-360d69dd-09a0-4d8d-8032-9abefbded6b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0847847 May 20 20:31:10.110874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-277a4a29-0d36-40a2-b932-32828f61f2a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.112372 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-277a4a29-0d36-40a2-b932-32828f61f2a7 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df&tenant_id=d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 1096 time: 0.0725572 May 20 20:31:10.159332 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2e6db2c0-2f9d-4460-bf50-0d881f45c6e4 req-6f82948a-56da-45cd-9522-92fbeddcc801 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462432 May 20 20:31:10.269088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-b9d63df0-a514-4f4e-812a-941314bf26b4 req-11367b6f-5767-4c78-9d55-56ce5a25d092 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:31:10.285049 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-6c950816-26aa-4c45-8740-a11f2f372183 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.286477 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-6c950816-26aa-4c45-8740-a11f2f372183 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1096 time: 0.1317599 May 20 20:31:10.291778 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-b9d63df0-a514-4f4e-812a-941314bf26b4 req-11367b6f-5767-4c78-9d55-56ce5a25d092 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:31:10.292821 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b9d63df0-a514-4f4e-812a-941314bf26b4 req-11367b6f-5767-4c78-9d55-56ce5a25d092 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6fa1dcc0-e314-49ca-b883-12c3e1fbac8e HTTP/1.1" status: 200 len: 210 time: 0.0685153 May 20 20:31:10.350195 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd7c5b5-7e73-4fdf-9cab-18adbe88692d req-5c3e390b-b174-4636-b062-0156e648a772 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.352216 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-efd7c5b5-7e73-4fdf-9cab-18adbe88692d req-5c3e390b-b174-4636-b062-0156e648a772 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0821583 May 20 20:31:10.411407 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-efd7c5b5-7e73-4fdf-9cab-18adbe88692d req-c7890f09-62dc-4075-a5ba-f83129b70082 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409842 May 20 20:31:10.422695 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-44394c2c-5657-4fbb-b776-17b9ac751074 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.424135 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-44394c2c-5657-4fbb-b776-17b9ac751074 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1262407 May 20 20:31:10.584087 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-5a90f68d-9b58-4a60-a910-ab4a5f86ae75 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 998 time: 0.1370032 May 20 20:31:10.668384 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-2d41c876-c9c2-4c38-822e-f0e1443f879f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.669699 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-2d41c876-c9c2-4c38-822e-f0e1443f879f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0702720 May 20 20:31:10.681481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-643b4cd4-3c31-48a2-b8b9-0e7807f0d27c req-123fff4c-1efb-451b-9f4d-13bf9956f4e2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.682942 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-643b4cd4-3c31-48a2-b8b9-0e7807f0d27c req-123fff4c-1efb-451b-9f4d-13bf9956f4e2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.1421685 May 20 20:31:10.773330 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-643b4cd4-3c31-48a2-b8b9-0e7807f0d27c req-411a710b-9fd3-4c13-91d6-baa90d9a025f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0842812 May 20 20:31:10.790245 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-7fac047c-576a-4e35-9e1d-c37c39cd5ded service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:10.791692 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-7fac047c-576a-4e35-9e1d-c37c39cd5ded service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0903153 May 20 20:31:10.958394 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-52b00fed-6212-45ac-896d-78acb477d246 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1226025 May 20 20:31:11.138249 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-84428696-7c35-4851-9eeb-3f73dc4bfa8e service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1255624 May 20 20:31:11.365419 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8de400b-ecc2-458b-b2c4-25bdff37c3da req-ede8142b-fd7d-4dfd-91ca-2de7f88f5f86 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:11.366938 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f8de400b-ecc2-458b-b2c4-25bdff37c3da req-ede8142b-fd7d-4dfd-91ca-2de7f88f5f86 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0881374 May 20 20:31:11.412470 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f8de400b-ecc2-458b-b2c4-25bdff37c3da req-923638d9-b7cf-4d36-8545-34991a9ca6e4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397696 May 20 20:31:11.458987 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8be5d189-5a62-4f11-8908-3833ca76d63e no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:31:11.496797 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 8be5d189-5a62-4f11-8908-3833ca76d63e {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:31:11.497145 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8be5d189-5a62-4f11-8908-3833ca76d63e not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:31:11.610872 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a0efcf-7c45-425a-9e7f-6decc0eb3db0 req-8b659d12-dfa6-433e-92e8-aa06e2db2bd3 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:11.612373 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-48a0efcf-7c45-425a-9e7f-6decc0eb3db0 req-8b659d12-dfa6-433e-92e8-aa06e2db2bd3 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0877621 May 20 20:31:11.660278 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-48a0efcf-7c45-425a-9e7f-6decc0eb3db0 req-6f83eab4-5dc4-41f0-8561-c5b30eb4a4a8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411825 May 20 20:31:11.988458 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4497b4-35d4-4794-9123-5dcd5ab2e337 req-38913864-4f38-402e-901f-6e26e5a5737d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:11.989807 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dc4497b4-35d4-4794-9123-5dcd5ab2e337 req-38913864-4f38-402e-901f-6e26e5a5737d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0940130 May 20 20:31:12.037649 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dc4497b4-35d4-4794-9123-5dcd5ab2e337 req-db27cdea-8cfb-4768-9605-3213c1cf2d6b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408783 May 20 20:31:12.866026 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9c7b6c-0b60-4053-aebe-608b4d565dce req-72783182-a23a-4ad4-939a-11f6f0e6d7bf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:12.868852 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6e9c7b6c-0b60-4053-aebe-608b4d565dce req-72783182-a23a-4ad4-939a-11f6f0e6d7bf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1024115 May 20 20:31:12.919228 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6e9c7b6c-0b60-4053-aebe-608b4d565dce req-c4602f73-d74c-4b6a-9063-fc7940b3ade2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425072 May 20 20:31:13.010586 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4cfe77-e426-4751-90dd-82a5991c4893 req-a112a688-e964-49b0-888d-6071ab33a256 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:13.012064 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d4cfe77-e426-4751-90dd-82a5991c4893 req-a112a688-e964-49b0-888d-6071ab33a256 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0800953 May 20 20:31:13.061865 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d4cfe77-e426-4751-90dd-82a5991c4893 req-a338b17a-94f9-434f-b88b-898e095d9e2e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436337 May 20 20:31:13.234528 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ac4ff44-d1fc-4ba9-9cd0-dfb539be08f4 req-8ff9c61a-733c-4b2d-a6b3-5b4c11d28f26 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:13.236090 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ac4ff44-d1fc-4ba9-9cd0-dfb539be08f4 req-8ff9c61a-733c-4b2d-a6b3-5b4c11d28f26 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0836122 May 20 20:31:13.286745 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ac4ff44-d1fc-4ba9-9cd0-dfb539be08f4 req-24ae9bcc-0684-49b0-a525-9b0bccb58125 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448654 May 20 20:31:14.105200 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d660331b-2a94-4f34-b7c1-551ec7973b50 req-cddfa465-096d-40eb-8801-9f1a65814d58 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:14.106649 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d660331b-2a94-4f34-b7c1-551ec7973b50 req-cddfa465-096d-40eb-8801-9f1a65814d58 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0790074 May 20 20:31:14.155794 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d660331b-2a94-4f34-b7c1-551ec7973b50 req-ab17b962-7a9f-4a9a-8f06-07d72cf9aed0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431862 May 20 20:31:14.253248 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69b7e4e-297d-4b16-896b-0735d6b1aea3 req-90a45581-230a-46c9-8d4b-9067f685dfd4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:14.254707 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c69b7e4e-297d-4b16-896b-0735d6b1aea3 req-90a45581-230a-46c9-8d4b-9067f685dfd4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0811718 May 20 20:31:14.300654 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c69b7e4e-297d-4b16-896b-0735d6b1aea3 req-32d0755e-b3ab-4359-ba70-e945bf22d0e9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393195 May 20 20:31:14.488093 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68a7e108-1459-4679-8495-7c924e044d9b req-14c8a181-8b45-42e1-bb32-65ff370bf664 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:14.489444 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68a7e108-1459-4679-8495-7c924e044d9b req-14c8a181-8b45-42e1-bb32-65ff370bf664 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0915430 May 20 20:31:14.535078 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68a7e108-1459-4679-8495-7c924e044d9b req-4556fa2d-fbfa-4b7c-9ac9-377a96fe2d6f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388982 May 20 20:31:14.988397 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:15.347603 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05818e8-50b9-4f00-8c3b-0e3f3658176f req-c999b8d1-4083-4f85-baaf-d1a3803d6262 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:15.349084 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d05818e8-50b9-4f00-8c3b-0e3f3658176f req-c999b8d1-4083-4f85-baaf-d1a3803d6262 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0857241 May 20 20:31:15.401191 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d05818e8-50b9-4f00-8c3b-0e3f3658176f req-1520af69-3686-4c25-b2ac-2e1a90a298fe tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459602 May 20 20:31:15.491193 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-758c41d2-7b2d-4b33-b699-82eb0ced4074 req-da42d1d9-969e-46a9-9236-5126f97d1029 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:15.492702 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-758c41d2-7b2d-4b33-b699-82eb0ced4074 req-da42d1d9-969e-46a9-9236-5126f97d1029 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0803521 May 20 20:31:15.542186 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-758c41d2-7b2d-4b33-b699-82eb0ced4074 req-7c39edb7-7888-415f-832a-6b7ce0214e0f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437651 May 20 20:31:15.730351 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5e7e0d-6923-40f4-b32f-7db30bdc9c41 req-7b3ebe76-9df3-45c8-88c2-e5ff7820c5c0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:15.731885 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1e5e7e0d-6923-40f4-b32f-7db30bdc9c41 req-7b3ebe76-9df3-45c8-88c2-e5ff7820c5c0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0819476 May 20 20:31:15.778651 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1e5e7e0d-6923-40f4-b32f-7db30bdc9c41 req-6ddc2adc-0a60-4350-8a90-ae34d30d3373 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411117 May 20 20:31:16.618016 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cdde33-af1c-4ec0-9469-97fb5d63e006 req-9869a0aa-3e6c-40af-9df4-4f17f3781012 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:16.619584 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c2cdde33-af1c-4ec0-9469-97fb5d63e006 req-9869a0aa-3e6c-40af-9df4-4f17f3781012 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0831704 May 20 20:31:16.666551 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c2cdde33-af1c-4ec0-9469-97fb5d63e006 req-3264e3f7-3e85-49ec-8253-465be6e50206 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412235 May 20 20:31:16.800521 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb1bd56-b965-4046-a66d-7b32d5084570 req-29f899b9-128b-4151-820c-e909beb14358 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:16.801973 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eeb1bd56-b965-4046-a66d-7b32d5084570 req-29f899b9-128b-4151-820c-e909beb14358 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.1499832 May 20 20:31:16.853238 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eeb1bd56-b965-4046-a66d-7b32d5084570 req-6438d789-2123-4f5f-8abf-d9f9b507a04b tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452261 May 20 20:31:16.978337 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3939f033-6b4a-4111-bb81-86bbe6ea7cad req-0a9ddec0-c601-43fd-a9ca-b8e9483350a5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:16.979796 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3939f033-6b4a-4111-bb81-86bbe6ea7cad req-0a9ddec0-c601-43fd-a9ca-b8e9483350a5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0840967 May 20 20:31:17.105386 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3939f033-6b4a-4111-bb81-86bbe6ea7cad req-120967ad-ac1a-4f5b-8c5b-2f2fcccf5a85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1199043 May 20 20:31:17.858972 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b181c388-ab5a-4411-8016-7a9f88265571 req-1348270d-22af-4eb9-b6d1-5ef120b29f85 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:17.860466 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b181c388-ab5a-4411-8016-7a9f88265571 req-1348270d-22af-4eb9-b6d1-5ef120b29f85 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0840263 May 20 20:31:17.911660 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b181c388-ab5a-4411-8016-7a9f88265571 req-15da0d8e-a7f5-457a-b470-f07eb9339869 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453811 May 20 20:31:18.048104 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e484ea56-49e3-4dae-be92-1216f60c4d4a req-0b22c172-5435-4640-83b8-e66cd2fd9d52 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:18.049761 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e484ea56-49e3-4dae-be92-1216f60c4d4a req-0b22c172-5435-4640-83b8-e66cd2fd9d52 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0818605 May 20 20:31:18.099644 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e484ea56-49e3-4dae-be92-1216f60c4d4a req-8d8c8a0b-744c-4564-814b-199ce05e607a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430517 May 20 20:31:18.298685 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abdf2525-aa6f-4312-a6d6-a04559c97311 req-18ad9884-2783-41d5-94de-424a45bad12c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:18.300194 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-abdf2525-aa6f-4312-a6d6-a04559c97311 req-18ad9884-2783-41d5-94de-424a45bad12c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0800586 May 20 20:31:18.345222 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-abdf2525-aa6f-4312-a6d6-a04559c97311 req-cc5dae53-3f8e-46f9-b9ba-ca740afb29f6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381718 May 20 20:31:19.097682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fab500a-312f-4ec9-b317-3d5e2b0b50d0 req-4e934e64-554d-45ba-a813-bf7a4e78c3ce tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:19.099158 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0fab500a-312f-4ec9-b317-3d5e2b0b50d0 req-4e934e64-554d-45ba-a813-bf7a4e78c3ce tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0802395 May 20 20:31:19.146693 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0fab500a-312f-4ec9-b317-3d5e2b0b50d0 req-e6a11125-d240-4601-8103-6fd97feabe1c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400460 May 20 20:31:19.296365 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85a56dc-bb97-431f-9a59-1d7d5fedfc5b req-05ef7ce9-7011-4b24-a769-a98802947d91 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:19.298010 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c85a56dc-bb97-431f-9a59-1d7d5fedfc5b req-05ef7ce9-7011-4b24-a769-a98802947d91 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0860555 May 20 20:31:19.343795 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c85a56dc-bb97-431f-9a59-1d7d5fedfc5b req-18d6a574-07b2-47c8-bd1d-23baf925f194 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402436 May 20 20:31:19.543729 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-072690e0-c18f-48d5-8605-d93b6f146d29 req-3bd62aae-ffa1-49a4-bed7-8c6258af0bb4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:19.545105 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-072690e0-c18f-48d5-8605-d93b6f146d29 req-3bd62aae-ffa1-49a4-bed7-8c6258af0bb4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0863848 May 20 20:31:19.589635 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-072690e0-c18f-48d5-8605-d93b6f146d29 req-46579bf6-cbc8-464c-ab7d-36dee177a700 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386503 May 20 20:31:20.339850 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee4c2800-5e6b-45d8-b548-d46c47803f0d req-84838187-fb43-4718-89ae-69100f59af1c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:20.341401 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ee4c2800-5e6b-45d8-b548-d46c47803f0d req-84838187-fb43-4718-89ae-69100f59af1c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0842955 May 20 20:31:20.394075 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ee4c2800-5e6b-45d8-b548-d46c47803f0d req-58230220-1207-4e69-a681-79b45eef05fc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467362 May 20 20:31:20.533528 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b5fe5a6-db44-48f6-bd4b-20e7ca2bdb2d req-6aef35d8-94a3-4df9-952a-70199222a93a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:20.534864 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6b5fe5a6-db44-48f6-bd4b-20e7ca2bdb2d req-6aef35d8-94a3-4df9-952a-70199222a93a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0776746 May 20 20:31:20.579976 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6b5fe5a6-db44-48f6-bd4b-20e7ca2bdb2d req-7101a68c-5266-4ed7-80b8-a2e376b37a80 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385880 May 20 20:31:20.782433 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1f03d64-e846-4554-995e-09d2261bf673 req-f18bc0be-d982-4262-9bd6-1f70cdddf886 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:20.783974 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1f03d64-e846-4554-995e-09d2261bf673 req-f18bc0be-d982-4262-9bd6-1f70cdddf886 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0807614 May 20 20:31:20.829987 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1f03d64-e846-4554-995e-09d2261bf673 req-fcd09e76-d835-4bbc-a17d-ba8c1f47ec59 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401099 May 20 20:31:21.588538 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00220839-0326-4ab5-9d30-2a1f6d06059a req-42285587-de9f-4be5-8377-f6be2829ddb8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:21.589891 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-00220839-0326-4ab5-9d30-2a1f6d06059a req-42285587-de9f-4be5-8377-f6be2829ddb8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0875797 May 20 20:31:21.636127 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-00220839-0326-4ab5-9d30-2a1f6d06059a req-8cce3e7c-6988-4164-96d0-2e097c7a5046 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403535 May 20 20:31:21.770770 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd4e50c4-4fc1-4b45-884a-85f478609ffd req-d44aa66c-e8fb-4c58-a7a7-c4cb51610446 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:21.772274 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dd4e50c4-4fc1-4b45-884a-85f478609ffd req-d44aa66c-e8fb-4c58-a7a7-c4cb51610446 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0833771 May 20 20:31:21.817922 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dd4e50c4-4fc1-4b45-884a-85f478609ffd req-17dfb691-bb90-496e-af6a-5c8a7c932eed tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391951 May 20 20:31:22.021273 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-130c2eb9-a75e-4b65-9b72-8237ff37df28 req-38f03eff-f522-4839-86a4-c13ddcfd3ea1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:22.022721 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-130c2eb9-a75e-4b65-9b72-8237ff37df28 req-38f03eff-f522-4839-86a4-c13ddcfd3ea1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0814636 May 20 20:31:22.071551 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-130c2eb9-a75e-4b65-9b72-8237ff37df28 req-892651b1-55aa-462d-8acd-038aed3dd607 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423863 May 20 20:31:22.819691 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde817d5-2ae4-4a00-86cc-19457d7e0985 req-65ab3bbe-6937-4406-8a6a-a97f4bc416e5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:22.821231 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-bde817d5-2ae4-4a00-86cc-19457d7e0985 req-65ab3bbe-6937-4406-8a6a-a97f4bc416e5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0794244 May 20 20:31:22.870560 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-bde817d5-2ae4-4a00-86cc-19457d7e0985 req-f8ebbebd-effd-4099-aa5a-b549d1ad6adf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433767 May 20 20:31:23.008590 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe35198-dda4-42c4-ace8-9aa38f21d6d9 req-95d1c984-6737-4cf0-86c2-16b1a88d8caf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:23.009976 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-efe35198-dda4-42c4-ace8-9aa38f21d6d9 req-95d1c984-6737-4cf0-86c2-16b1a88d8caf tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0793059 May 20 20:31:23.055214 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-efe35198-dda4-42c4-ace8-9aa38f21d6d9 req-fa85dfed-e48a-4d56-8801-4d84c5ced1ea tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394642 May 20 20:31:23.264545 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970e16a8-7642-4398-b645-74887fd73d09 req-07719f15-44a1-4e03-8479-1271027bbd61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:23.265905 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-970e16a8-7642-4398-b645-74887fd73d09 req-07719f15-44a1-4e03-8479-1271027bbd61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0814316 May 20 20:31:23.312605 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-970e16a8-7642-4398-b645-74887fd73d09 req-b9c07413-3587-4bd7-9857-085ee33d2855 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410402 May 20 20:31:24.063106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b09bb2-c038-47c9-b965-c13ca31b491a req-80388da8-f9eb-4168-a67b-dc7ee52aace4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:24.064587 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-15b09bb2-c038-47c9-b965-c13ca31b491a req-80388da8-f9eb-4168-a67b-dc7ee52aace4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0857971 May 20 20:31:24.111917 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-15b09bb2-c038-47c9-b965-c13ca31b491a req-6201b0f8-5380-4d6c-9bb2-1ae6314d6953 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404310 May 20 20:31:24.248281 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20c1976-df89-415e-9ef7-8fe8b34ff0ad req-efc532f1-5e00-4638-bcf7-f66d9c79f51b tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:24.249747 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f20c1976-df89-415e-9ef7-8fe8b34ff0ad req-efc532f1-5e00-4638-bcf7-f66d9c79f51b tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0886905 May 20 20:31:24.295455 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f20c1976-df89-415e-9ef7-8fe8b34ff0ad req-77fe8653-1770-414d-8a2f-a7fa37831d91 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399771 May 20 20:31:24.504471 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95be1950-4b90-403e-9a4e-7ce227546763 req-6445165e-ea96-40a4-a02f-fb375c62af56 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:24.505924 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-95be1950-4b90-403e-9a4e-7ce227546763 req-6445165e-ea96-40a4-a02f-fb375c62af56 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0812221 May 20 20:31:24.552727 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-95be1950-4b90-403e-9a4e-7ce227546763 req-7dd268a8-0a9a-4bd7-82b6-c2cb863a186c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405416 May 20 20:31:25.306005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-552d92e9-486a-4a3f-a39a-31c3138b0376 req-f857cf16-35bc-4a08-aa3c-c2c16a752a13 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:25.307500 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-552d92e9-486a-4a3f-a39a-31c3138b0376 req-f857cf16-35bc-4a08-aa3c-c2c16a752a13 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0814300 May 20 20:31:25.355866 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-552d92e9-486a-4a3f-a39a-31c3138b0376 req-18760905-fe13-4fb3-840e-3a9fb5db14d5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426619 May 20 20:31:25.487728 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a57b27-12e9-4643-a346-8330d1291d26 req-4a10f220-ad2a-471a-b345-90b4aad02619 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:25.489097 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-11a57b27-12e9-4643-a346-8330d1291d26 req-4a10f220-ad2a-471a-b345-90b4aad02619 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0847099 May 20 20:31:25.534035 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-11a57b27-12e9-4643-a346-8330d1291d26 req-18ccadef-8de2-42d0-9b9e-fd34b38aa511 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392456 May 20 20:31:25.750294 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35e7482-79ce-4686-9675-8960ba291788 req-5d02e227-d398-418b-92d3-332ef2f7e01d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:25.751638 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a35e7482-79ce-4686-9675-8960ba291788 req-5d02e227-d398-418b-92d3-332ef2f7e01d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0838149 May 20 20:31:25.798051 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a35e7482-79ce-4686-9675-8960ba291788 req-348e46a3-30ff-474c-836b-a3ee560bca37 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407233 May 20 20:31:26.547401 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99140cd1-6864-488d-9fe8-e8059ef4d95d req-3a32bba0-3984-4626-824b-a63feca3a3d0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:26.548753 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-99140cd1-6864-488d-9fe8-e8059ef4d95d req-3a32bba0-3984-4626-824b-a63feca3a3d0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0820172 May 20 20:31:26.596716 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-99140cd1-6864-488d-9fe8-e8059ef4d95d req-f904a4ce-23ef-4ac3-ade3-ca2be48c3c4f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421288 May 20 20:31:26.728916 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05ada5c-32e7-4d01-8b6e-bdbf86b18780 req-5dfa9b7e-cd3f-46c6-9e2d-90a0c061085c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:26.730398 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e05ada5c-32e7-4d01-8b6e-bdbf86b18780 req-5dfa9b7e-cd3f-46c6-9e2d-90a0c061085c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0800970 May 20 20:31:26.778664 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e05ada5c-32e7-4d01-8b6e-bdbf86b18780 req-9979d1cd-5164-4060-b963-df2915486c57 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424864 May 20 20:31:26.997955 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf63311-2c2a-408f-ae33-11017617f262 req-61dd4f85-0886-4252-8ff0-3982363f2b85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:26.999390 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-caf63311-2c2a-408f-ae33-11017617f262 req-61dd4f85-0886-4252-8ff0-3982363f2b85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0879607 May 20 20:31:27.046596 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-caf63311-2c2a-408f-ae33-11017617f262 req-97c10d8a-651b-40c0-bb48-a759a1f27795 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413702 May 20 20:31:27.794949 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c31cc21e-c6a3-4f3c-aadb-d140cdde07c8 req-8adfc643-5399-4efe-a12a-4b644553e3c2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:27.796443 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c31cc21e-c6a3-4f3c-aadb-d140cdde07c8 req-8adfc643-5399-4efe-a12a-4b644553e3c2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0804873 May 20 20:31:27.846899 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c31cc21e-c6a3-4f3c-aadb-d140cdde07c8 req-f85e865b-6dfc-4062-8757-c6cff4c2454c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445068 May 20 20:31:27.973236 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a131aeb2-24f8-46f8-896a-9c22e0d62186 req-09f5c709-ef0f-46e4-a3a7-65a523567e94 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:27.974569 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a131aeb2-24f8-46f8-896a-9c22e0d62186 req-09f5c709-ef0f-46e4-a3a7-65a523567e94 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0831394 May 20 20:31:28.020874 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a131aeb2-24f8-46f8-896a-9c22e0d62186 req-769e7fbb-7a5c-4e9f-bcf0-7f9faa53296d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405574 May 20 20:31:28.244788 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555fc4fe-eb32-4c74-bcbe-30c61126a970 req-2b75b4ee-d132-4eef-9082-fcc230077eb1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:28.246196 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-555fc4fe-eb32-4c74-bcbe-30c61126a970 req-2b75b4ee-d132-4eef-9082-fcc230077eb1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0863693 May 20 20:31:28.292221 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-555fc4fe-eb32-4c74-bcbe-30c61126a970 req-113460cd-190d-465b-b4a7-10d59354d1f5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401952 May 20 20:31:29.038410 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfaade4c-2eed-4bd8-9daa-3a7bfa238d29 req-6eb14f80-db6f-4e3e-bc9d-d303c3f04856 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:29.040527 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bfaade4c-2eed-4bd8-9daa-3a7bfa238d29 req-6eb14f80-db6f-4e3e-bc9d-d303c3f04856 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0843275 May 20 20:31:29.091487 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bfaade4c-2eed-4bd8-9daa-3a7bfa238d29 req-86d4d365-a645-478a-a09d-6be9f44423c2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449314 May 20 20:31:29.219621 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f5c542-c6b0-4848-a898-87b6c9326bfb req-25e41692-27e7-4d01-beea-fb7abf56d51a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:29.221114 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-09f5c542-c6b0-4848-a898-87b6c9326bfb req-25e41692-27e7-4d01-beea-fb7abf56d51a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0853188 May 20 20:31:29.266923 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-09f5c542-c6b0-4848-a898-87b6c9326bfb req-3944ba4b-8d26-4e8b-a8b0-ed9ffda487e8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390284 May 20 20:31:29.489630 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0624e75d-d40c-4813-bf7b-cf56e2d1fb72 req-dd03d77f-724e-4b1c-81b5-1c12d6725618 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:29.491011 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0624e75d-d40c-4813-bf7b-cf56e2d1fb72 req-dd03d77f-724e-4b1c-81b5-1c12d6725618 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0864191 May 20 20:31:29.536283 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0624e75d-d40c-4813-bf7b-cf56e2d1fb72 req-e004ebb5-d988-4331-a1a0-edf27aa02052 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386920 May 20 20:31:30.285454 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a124b6d2-c816-461b-8fe0-d9e77cebc61d req-0756c5c0-379c-4f86-a3de-167255ba7e64 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:30.286901 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a124b6d2-c816-461b-8fe0-d9e77cebc61d req-0756c5c0-379c-4f86-a3de-167255ba7e64 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0874698 May 20 20:31:30.334644 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a124b6d2-c816-461b-8fe0-d9e77cebc61d req-cc83124b-1a54-434f-b323-0e98f2c8e936 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415971 May 20 20:31:30.459329 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7faf883-933d-4f4a-8b71-96b024f11a72 req-6c294cd4-39c7-44dd-a670-f2cee3616c9f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:30.460969 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b7faf883-933d-4f4a-8b71-96b024f11a72 req-6c294cd4-39c7-44dd-a670-f2cee3616c9f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0827153 May 20 20:31:30.511178 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b7faf883-933d-4f4a-8b71-96b024f11a72 req-db094cd2-9b66-493c-ba8f-2598204af1d9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443859 May 20 20:31:30.732028 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524f3dc7-1758-4d10-a2a9-1820fe378ff1 req-1f7f30e8-8af8-4750-af58-2df6c892e545 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:30.733455 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-524f3dc7-1758-4d10-a2a9-1820fe378ff1 req-1f7f30e8-8af8-4750-af58-2df6c892e545 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0806823 May 20 20:31:30.783880 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-524f3dc7-1758-4d10-a2a9-1820fe378ff1 req-77b152df-29ae-40d7-9971-861b4144a875 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445902 May 20 20:31:31.519648 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf8453ef-bd85-47f0-a257-6d3d4d48970d req-a6fde68c-0264-45a1-abf9-9fd91095ef57 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:31.521060 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bf8453ef-bd85-47f0-a257-6d3d4d48970d req-a6fde68c-0264-45a1-abf9-9fd91095ef57 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0788281 May 20 20:31:31.568202 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bf8453ef-bd85-47f0-a257-6d3d4d48970d req-f0229080-d7d3-47ef-b184-8419453ad0ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406437 May 20 20:31:31.766705 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c2bce6-2845-460f-9890-593b9a44b1bc req-f43d6fde-ab53-4f1d-9b83-b0b8d862693a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:31.768245 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-98c2bce6-2845-460f-9890-593b9a44b1bc req-f43d6fde-ab53-4f1d-9b83-b0b8d862693a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.1516292 May 20 20:31:31.813508 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-98c2bce6-2845-460f-9890-593b9a44b1bc req-dbfb95c5-145f-4d09-bb57-be8be9913ede tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394597 May 20 20:31:31.978987 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf43999e-332c-4af1-bc8c-e15ebb7e7534 req-c2ad8f5e-5c8f-43f9-baea-e621a619edd4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:31.980449 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bf43999e-332c-4af1-bc8c-e15ebb7e7534 req-c2ad8f5e-5c8f-43f9-baea-e621a619edd4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0838435 May 20 20:31:32.091716 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bf43999e-332c-4af1-bc8c-e15ebb7e7534 req-d4665145-82e9-4b24-b7c5-07eddeec90bd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1049304 May 20 20:31:32.762389 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b31c9c-f0e3-4b4b-be9a-a04cb6211c9b req-5bf8a761-201a-467d-bd6f-706f8bb4eb69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:32.763924 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-53b31c9c-f0e3-4b4b-be9a-a04cb6211c9b req-5bf8a761-201a-467d-bd6f-706f8bb4eb69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0849507 May 20 20:31:32.810907 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-53b31c9c-f0e3-4b4b-be9a-a04cb6211c9b req-e60bbe4c-b6f5-42ae-b6fa-d873274e443d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410011 May 20 20:31:33.003608 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000e3b00-a9f7-4e31-9738-2d33f56ab409 req-dfcbebec-a0b2-43d7-951e-387a77b4bd26 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:33.005108 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-000e3b00-a9f7-4e31-9738-2d33f56ab409 req-dfcbebec-a0b2-43d7-951e-387a77b4bd26 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0812593 May 20 20:31:33.054629 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-000e3b00-a9f7-4e31-9738-2d33f56ab409 req-cd4685b7-8d94-42b5-ba38-8157a129af73 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431006 May 20 20:31:33.294071 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140f3510-f5d2-4198-8499-42f67bbc5beb req-4a46ce24-c294-46f2-add6-3db9ce4d1106 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:33.295565 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-140f3510-f5d2-4198-8499-42f67bbc5beb req-4a46ce24-c294-46f2-add6-3db9ce4d1106 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0801899 May 20 20:31:33.343332 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-140f3510-f5d2-4198-8499-42f67bbc5beb req-af546efa-df5f-4f06-9b92-670117ea3bea tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419247 May 20 20:31:33.999687 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a734dc6-319d-4947-bd2c-f9b56f537c7b req-cd5c6394-6938-4166-b605-03e8960e7ebf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:34.001099 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9a734dc6-319d-4947-bd2c-f9b56f537c7b req-cd5c6394-6938-4166-b605-03e8960e7ebf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0839863 May 20 20:31:34.048947 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9a734dc6-319d-4947-bd2c-f9b56f537c7b req-213a571b-edc2-4a85-aa0b-189d6f25fb5b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414927 May 20 20:31:34.242191 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87684cc0-715b-48fc-a6e5-07a28d5fb1c2 req-0e32eda7-e491-41b3-b788-a8491184416f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:34.244725 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87684cc0-715b-48fc-a6e5-07a28d5fb1c2 req-0e32eda7-e491-41b3-b788-a8491184416f tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0830371 May 20 20:31:34.291391 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-87684cc0-715b-48fc-a6e5-07a28d5fb1c2 req-18b6d0e0-6c7d-4f91-91ba-f4ff9633eb67 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408864 May 20 20:31:34.538662 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5af76e5-9bc9-4cbe-8c6e-1e9f598546a7 req-13dff839-84c3-4838-a3f7-d47770e0a5b4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:34.540746 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f5af76e5-9bc9-4cbe-8c6e-1e9f598546a7 req-13dff839-84c3-4838-a3f7-d47770e0a5b4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0840042 May 20 20:31:34.585080 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f5af76e5-9bc9-4cbe-8c6e-1e9f598546a7 req-758b3cb8-43e1-482c-aac7-1ce3100eeef6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382874 May 20 20:31:34.762128 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8fb83dcf-c4c0-4890-9ec5-e457c67ae522 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:35.241941 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78607a3-36ba-46fd-9196-25768a111d7e req-b93b9567-d859-4086-ac30-2783db36844d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:35.243902 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c78607a3-36ba-46fd-9196-25768a111d7e req-b93b9567-d859-4086-ac30-2783db36844d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0863752 May 20 20:31:35.289348 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c78607a3-36ba-46fd-9196-25768a111d7e req-c2f0c5f1-ee44-49b3-be32-c63b91da4f79 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398037 May 20 20:31:35.490634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea788f1-6601-426a-a0f0-bed21b8b2ffb req-6a96f720-7bb7-4a0d-9e20-7cdece66c4e9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:35.492127 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bea788f1-6601-426a-a0f0-bed21b8b2ffb req-6a96f720-7bb7-4a0d-9e20-7cdece66c4e9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0839763 May 20 20:31:35.539382 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bea788f1-6601-426a-a0f0-bed21b8b2ffb req-811be5a0-ea22-4e4a-a72f-9901d67cd52e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407710 May 20 20:31:35.782238 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cbc0798-1807-473a-a8c5-3275521c6571 req-f192d2f6-4dbb-487e-b004-310ff9a36f63 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:35.783711 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2cbc0798-1807-473a-a8c5-3275521c6571 req-f192d2f6-4dbb-487e-b004-310ff9a36f63 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0812778 May 20 20:31:35.831379 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2cbc0798-1807-473a-a8c5-3275521c6571 req-7b95dd4e-7e71-47e9-8bfe-e4562a0d880b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415082 May 20 20:31:36.478853 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988c4414-d9c6-4253-950b-b39abcd29460 req-2290efac-8108-4975-8015-c5a208bb21f6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:36.480269 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-988c4414-d9c6-4253-950b-b39abcd29460 req-2290efac-8108-4975-8015-c5a208bb21f6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0844536 May 20 20:31:36.525465 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-988c4414-d9c6-4253-950b-b39abcd29460 req-404a29cd-f1a8-461c-87ea-4e800261c580 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391254 May 20 20:31:36.737107 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c881ccf-535e-4e04-b745-e28cd7092923 req-57cfbb93-c6a6-435a-9017-01ef508d1e77 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:36.738451 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c881ccf-535e-4e04-b745-e28cd7092923 req-57cfbb93-c6a6-435a-9017-01ef508d1e77 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0920367 May 20 20:31:36.784746 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c881ccf-535e-4e04-b745-e28cd7092923 req-98f73070-896b-4a8e-93bd-7dc4a03cc00d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399461 May 20 20:31:37.021955 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186a1801-190e-4cc4-a9b4-7244c4c13382 req-0adfb1f3-fa42-4372-846b-b0c4e8d185b4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:37.023346 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-186a1801-190e-4cc4-a9b4-7244c4c13382 req-0adfb1f3-fa42-4372-846b-b0c4e8d185b4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0807104 May 20 20:31:37.073652 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-186a1801-190e-4cc4-a9b4-7244c4c13382 req-7f8c4f92-28f6-490c-a98c-e61ed39369d8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430737 May 20 20:31:37.216882 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:37.482511 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7e920eb9-f64e-40bd-91c3-bcf31683074d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:37.709217 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29686a4d-700f-4bd4-8778-764eb63d7cde req-1c3427bc-37b4-45c8-adb2-ed0ff5bc4daf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:37.710920 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-29686a4d-700f-4bd4-8778-764eb63d7cde req-1c3427bc-37b4-45c8-adb2-ed0ff5bc4daf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0799999 May 20 20:31:37.758318 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-29686a4d-700f-4bd4-8778-764eb63d7cde req-a5aad6d2-5fa6-4dbd-ac26-52bf0d75ca8c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413854 May 20 20:31:37.972535 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812ad5aa-82e5-4a4f-8d77-61021301710a req-6932b6cb-78b0-43a7-a439-4801f9ffa099 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:37.974033 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-812ad5aa-82e5-4a4f-8d77-61021301710a req-6932b6cb-78b0-43a7-a439-4801f9ffa099 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0798762 May 20 20:31:38.026629 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-812ad5aa-82e5-4a4f-8d77-61021301710a req-73ce4d57-09cd-4fe9-b4ec-cd7f0035fb20 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451636 May 20 20:31:38.203031 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-9f6c897f-fd18-4dd5-92bc-18d9f3e9a732 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0741422 May 20 20:31:38.272920 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:38.277401 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d263cb1-41e6-4afa-9d70-c32385f02521 req-1b64f861-413d-4708-b125-6fe11c2085a2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:38.278926 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2d263cb1-41e6-4afa-9d70-c32385f02521 req-1b64f861-413d-4708-b125-6fe11c2085a2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0885458 May 20 20:31:38.326980 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2d263cb1-41e6-4afa-9d70-c32385f02521 req-471c5eaa-95be-4201-950b-33695c357dff tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420039 May 20 20:31:38.333374 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-688543f9-a533-4ee6-bfce-1deff92a5eec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:38.334835 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-688543f9-a533-4ee6-bfce-1deff92a5eec service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1099 time: 0.0745270 May 20 20:31:38.492854 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-8c453293-3e62-4a2b-9dcf-782ecd97b911 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:38.494788 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-8c453293-3e62-4a2b-9dcf-782ecd97b911 service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.1237969 May 20 20:31:38.604109 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-cd0401e3-138c-4323-957f-7c5ee1b1bc28 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 1001 time: 0.0930238 May 20 20:31:38.670153 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-3ff31179-4446-4d5d-904d-71d2097eb0d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:38.671533 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-3ff31179-4446-4d5d-904d-71d2097eb0d3 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.0560226 May 20 20:31:38.754620 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-5b93ce8d-5b78-4a9e-b379-ab238c8f8f61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:38.755986 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-5b93ce8d-5b78-4a9e-b379-ab238c8f8f61 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0711942 May 20 20:31:38.943310 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-42772d1b-0827-42d5-b8a9-f3a092f7eb08 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1716146 May 20 20:31:38.965237 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6281057-4d29-4024-a1fe-15afa0001039 req-59da006a-0e04-498b-86ec-a06c8fc78e77 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:38.966649 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6281057-4d29-4024-a1fe-15afa0001039 req-59da006a-0e04-498b-86ec-a06c8fc78e77 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1001117 May 20 20:31:39.100394 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6281057-4d29-4024-a1fe-15afa0001039 req-9af29a79-ede6-4b99-8c9a-21cc7b6bccb9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148167 May 20 20:31:39.127340 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ba494d0-6ce4-4f91-b66d-d54b3e06cd07 req-5e4fb0c5-fb7f-4f7d-9cfc-e2600f009517 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1593828 May 20 20:31:39.223318 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf0dcb9-d428-4702-a4cc-3478959b1c23 req-df22396b-f10a-4735-8d61-2399a03d4773 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:39.225066 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-abf0dcb9-d428-4702-a4cc-3478959b1c23 req-df22396b-f10a-4735-8d61-2399a03d4773 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0878961 May 20 20:31:39.272088 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-abf0dcb9-d428-4702-a4cc-3478959b1c23 req-20b3c53d-6d42-4741-a2a6-1e8c7419638e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405297 May 20 20:31:39.589518 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c79335-b17c-4037-ac84-a0b832581ccc req-023b413d-8a04-44d4-b205-cdfdf028867b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:39.590947 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-72c79335-b17c-4037-ac84-a0b832581ccc req-023b413d-8a04-44d4-b205-cdfdf028867b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.1521623 May 20 20:31:39.635131 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-72c79335-b17c-4037-ac84-a0b832581ccc req-ba7b0175-8d12-4e14-9cdd-fdf40d5c9807 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383103 May 20 20:31:39.892017 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:40.285091 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11040b77-cb10-44e7-9251-60cdf5e65131 req-674dbe3b-8e50-4bab-8d05-3fae1ff4b0df tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:40.286541 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11040b77-cb10-44e7-9251-60cdf5e65131 req-674dbe3b-8e50-4bab-8d05-3fae1ff4b0df tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0816002 May 20 20:31:40.331862 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11040b77-cb10-44e7-9251-60cdf5e65131 req-a3a8aad1-a774-470b-a968-4f497156076f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395167 May 20 20:31:40.463094 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f19904-562e-4cf6-9f95-1dae846d55a6 req-d6943c09-78ba-4ca0-9a67-e6ecfbab0f6e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:40.464680 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-60f19904-562e-4cf6-9f95-1dae846d55a6 req-d6943c09-78ba-4ca0-9a67-e6ecfbab0f6e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0852497 May 20 20:31:40.510037 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-60f19904-562e-4cf6-9f95-1dae846d55a6 req-4a557e76-273c-456a-ac17-7f58670d198c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394423 May 20 20:31:40.830429 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551b4aa8-8aa4-4af7-9785-62f28130610f req-64d0e94d-a516-46e5-bb2f-a9cfeae0b6da tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:40.831817 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-551b4aa8-8aa4-4af7-9785-62f28130610f req-64d0e94d-a516-46e5-bb2f-a9cfeae0b6da tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0838208 May 20 20:31:40.877053 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-551b4aa8-8aa4-4af7-9785-62f28130610f req-636223be-061d-40af-b2b9-350f0cf19c01 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390484 May 20 20:31:41.122548 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f61195f-5092-4e7a-ae5a-cde5a125ad3f req-05b9bd61-8a66-490c-8cd7-6ab050e1c78e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:41.124003 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3f61195f-5092-4e7a-ae5a-cde5a125ad3f req-05b9bd61-8a66-490c-8cd7-6ab050e1c78e service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1098 time: 0.0674977 May 20 20:31:41.172836 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3f61195f-5092-4e7a-ae5a-cde5a125ad3f req-7320cebe-aa6e-41d7-b45f-d49ed423c365 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337129 May 20 20:31:41.521222 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dab5003-730d-4bc0-af4a-b71cae5e5818 req-fd7b2fea-3e26-442c-b12d-4c75b8dc0280 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:41.522551 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dab5003-730d-4bc0-af4a-b71cae5e5818 req-fd7b2fea-3e26-442c-b12d-4c75b8dc0280 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0820444 May 20 20:31:41.567409 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dab5003-730d-4bc0-af4a-b71cae5e5818 req-e0dd30bc-0486-4b9c-9117-34575983f290 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388892 May 20 20:31:41.697767 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d46179dd-fa67-4ec7-aa5d-ae32fabd1c8b req-98f7a064-fb7c-47fe-ab4d-d4b1946d5a72 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:41.699257 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d46179dd-fa67-4ec7-aa5d-ae32fabd1c8b req-98f7a064-fb7c-47fe-ab4d-d4b1946d5a72 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0839987 May 20 20:31:41.744741 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d46179dd-fa67-4ec7-aa5d-ae32fabd1c8b req-ba2fd990-fceb-4257-8807-ad47c942f2f2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397418 May 20 20:31:41.745205 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-3ec543f6-a89d-4589-ba16-aff7d08dc968 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:41.746633 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-3ec543f6-a89d-4589-ba16-aff7d08dc968 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 946 time: 0.0890939 May 20 20:31:41.895134 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Deleting port 90dacfdb-310f-446a-a389-3184996fd51e {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:31:41.895470 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:42.082033 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] For port 90dacfdb-310f-446a-a389-3184996fd51e, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=90dacfdb-310f-446a-a389-3184996fd51e,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:42.082381 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:42.209441 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Calling delete_port for 90dacfdb-310f-446a-a389-3184996fd51e owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:31:42.233781 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d718ff3-9ac7-45b7-ab4b-8dbcb7549aa0 req-55bcc665-6aa8-4c11-a035-76b9c48a2675 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:42.235249 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d718ff3-9ac7-45b7-ab4b-8dbcb7549aa0 req-55bcc665-6aa8-4c11-a035-76b9c48a2675 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.2468183 May 20 20:31:42.291784 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d718ff3-9ac7-45b7-ab4b-8dbcb7549aa0 req-9875e8c0-b1c0-41e3-a384-c9b446ba14ec tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497994 May 20 20:31:42.375023 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:42.381167 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-17f33ffb-a58a-431e-9fc0-c557b899243e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:42.395263 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4', '08f701b8-1580-4323-b2f2-c088e14e4e28', '90dacfdb-310f-446a-a389-3184996fd51e'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:31:42.425549 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event deleted for resources: {'Port': ['ID=90dacfdb-310f-446a-a389-3184996fd51e,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:42.460957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.461244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.462126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.462484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.462917 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.463286 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.463631 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.464006 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.464355 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.464702 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.465042 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.465385 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:42.472818 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:42.513950 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] No DVR routers for this DVR port 90dacfdb-310f-446a-a389-3184996fd51e on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:31:42.516429 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:42.519060 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b601b12-a621-4606-99b1-c22f99edbcce', 'name': 'network-vif-deleted', 'tag': '90dacfdb-310f-446a-a389-3184996fd51e'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:31:42.536743 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c640a9b9-4edd-4688-bbd2-f3f9f1b66c03 req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "DELETE /v2.0/ports/90dacfdb-310f-446a-a389-3184996fd51e HTTP/1.1" status: 204 len: 173 time: 0.7716639 May 20 20:31:42.569555 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b601b12-a621-4606-99b1-c22f99edbcce', 'name': 'network-vif-deleted', 'tag': '90dacfdb-310f-446a-a389-3184996fd51e', 'status': 'completed', 'code': 200} May 20 20:31:42.755344 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52f6015-415b-4fbb-b2eb-592a9da183fe req-f6f16495-af38-4b32-b228-c139bf486ab1 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:42.756725 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b52f6015-415b-4fbb-b2eb-592a9da183fe req-f6f16495-af38-4b32-b228-c139bf486ab1 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0800962 May 20 20:31:42.807237 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b52f6015-415b-4fbb-b2eb-592a9da183fe req-fa30cad2-9264-4cf6-bef2-6f58639bb6fb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438294 May 20 20:31:42.911387 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3c442274-42bc-4ed1-ac70-3b3db7675e3f req-2cd7fd86-6a26-45e2-8e7e-e8e7bba7a3b3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=6b601b12-a621-4606-99b1-c22f99edbcce HTTP/1.1" status: 200 len: 210 time: 0.0439296 May 20 20:31:43.482514 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93a5a74-fcde-4fcd-bdd9-437f4ea567d3 req-a0cd5bb5-c6cc-480c-a30b-0b8fb0ddcdf9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:43.484026 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d93a5a74-fcde-4fcd-bdd9-437f4ea567d3 req-a0cd5bb5-c6cc-480c-a30b-0b8fb0ddcdf9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0808713 May 20 20:31:43.529998 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d93a5a74-fcde-4fcd-bdd9-437f4ea567d3 req-c75113ae-98f4-4e00-b4a5-00463ce65616 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393751 May 20 20:31:43.994374 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6c57af-142b-4d76-9641-6a9cde7d8a06 req-26b9be8c-09d9-47b6-80ab-9806dd8317ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:43.995701 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ed6c57af-142b-4d76-9641-6a9cde7d8a06 req-26b9be8c-09d9-47b6-80ab-9806dd8317ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0810816 May 20 20:31:44.044942 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ed6c57af-142b-4d76-9641-6a9cde7d8a06 req-1f284dc5-da0a-467a-b0cf-90c904175dde tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435483 May 20 20:31:44.367637 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3a1cac-17ee-47f2-9ed8-d50378902b11 req-f6d73918-c047-4a80-97ed-d8ab3680dbe9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:44.368862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-da3a1cac-17ee-47f2-9ed8-d50378902b11 req-f6d73918-c047-4a80-97ed-d8ab3680dbe9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:31:44.420068 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-da3a1cac-17ee-47f2-9ed8-d50378902b11 req-f6d73918-c047-4a80-97ed-d8ab3680dbe9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:31:44.421193 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-da3a1cac-17ee-47f2-9ed8-d50378902b11 req-f6d73918-c047-4a80-97ed-d8ab3680dbe9 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.1362724 May 20 20:31:44.478551 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85cb6c1-0508-43c5-a925-13dbd8ddc0f9 req-b83a8889-e231-4a09-86b9-8d88f3267152 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:44.480042 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e85cb6c1-0508-43c5-a925-13dbd8ddc0f9 req-b83a8889-e231-4a09-86b9-8d88f3267152 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0809739 May 20 20:31:44.480405 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-da3a1cac-17ee-47f2-9ed8-d50378902b11 req-50cf897c-6c40-4add-8d1c-d30e1dde9198 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499446 May 20 20:31:44.486543 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-d059dc06-4c72-4368-8947-e920b4f5429d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:44.487975 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-d059dc06-4c72-4368-8947-e920b4f5429d service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1098 time: 0.1080179 May 20 20:31:44.526830 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e85cb6c1-0508-43c5-a925-13dbd8ddc0f9 req-b1263f16-2fa1-4c52-900e-98785c58c4e6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403295 May 20 20:31:44.754331 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-60228581-284b-4675-bc6a-93bdd03fce7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:44.755742 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-60228581-284b-4675-bc6a-93bdd03fce7e service neutron] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 919 time: 0.2497303 May 20 20:31:44.775404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e24a1bd-8d60-4a76-9194-5fb4c41b8bb0 req-62ba1693-0583-443b-96e0-92cb0210896e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:44.776795 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e24a1bd-8d60-4a76-9194-5fb4c41b8bb0 req-62ba1693-0583-443b-96e0-92cb0210896e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.1149848 May 20 20:31:44.799820 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:31:44.854517 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-791e4534-1d4d-480d-830e-4b0221fbed4a service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 200 len: 217 time: 0.0767007 May 20 20:31:44.904963 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e24a1bd-8d60-4a76-9194-5fb4c41b8bb0 req-d48b8858-3980-4c2e-84d3-c92fa732c0a7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0786197 May 20 20:31:44.933502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-81e16e79-0b38-479b-86d1-f9da75ae0a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:44.934930 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-81e16e79-0b38-479b-86d1-f9da75ae0a76 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.0627155 May 20 20:31:45.001242 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-cb1eb30d-b214-4635-8eef-ef2d849e6127 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0438814 May 20 20:31:45.003567 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:45.140073 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-cadde871-bdcb-49a6-b13e-9697c42ad219 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1249137 May 20 20:31:45.290032 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43bf8174-23af-4a82-9548-dee50b2ee30b req-cc6c44fa-cc0a-4f89-b268-46593f819f2f service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237650 May 20 20:31:45.635153 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 90dacfdb-310f-446a-a389-3184996fd51e no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:31:45.670753 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 90dacfdb-310f-446a-a389-3184996fd51e {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:31:45.670753 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 90dacfdb-310f-446a-a389-3184996fd51e not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:31:45.671926 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da56597-3222-468d-9770-8bb9afea3b21 req-dc476d83-d4bd-43eb-8fbd-2fc9f303229c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:45.673467 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3da56597-3222-468d-9770-8bb9afea3b21 req-dc476d83-d4bd-43eb-8fbd-2fc9f303229c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.0841734 May 20 20:31:45.714522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee2cc21-b59c-455d-8293-0fa3fce3c17d req-75d33698-7561-4114-99f2-63a555dc8dfb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:45.715711 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0ee2cc21-b59c-455d-8293-0fa3fce3c17d req-75d33698-7561-4114-99f2-63a555dc8dfb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0808208 May 20 20:31:45.719002 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3da56597-3222-468d-9770-8bb9afea3b21 req-c0a462c8-6787-4a87-824d-2b0149c99b64 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398149 May 20 20:31:45.759881 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0ee2cc21-b59c-455d-8293-0fa3fce3c17d req-35c62d3a-f6dc-4229-87ec-9a9c470e8c79 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383425 May 20 20:31:46.097000 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdad35a0-c384-4456-a79b-1b82ba44ced2 req-0ff4af1b-3b6a-4864-a2ef-3ae0e66ac995 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:46.098359 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cdad35a0-c384-4456-a79b-1b82ba44ced2 req-0ff4af1b-3b6a-4864-a2ef-3ae0e66ac995 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0820627 May 20 20:31:46.144318 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cdad35a0-c384-4456-a79b-1b82ba44ced2 req-04be9531-5801-44f2-947d-83032db1cba1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400686 May 20 20:31:46.907099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cba748c-deda-428c-ba60-f70fb2b13088 req-07e6a131-daa8-4196-80b6-2b6ef938b3d4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:46.908669 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4cba748c-deda-428c-ba60-f70fb2b13088 req-07e6a131-daa8-4196-80b6-2b6ef938b3d4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.0849826 May 20 20:31:46.956434 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4cba748c-deda-428c-ba60-f70fb2b13088 req-ba8087a6-bb74-4b54-8184-5aa21979d616 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415905 May 20 20:31:47.026476 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2069cb-2138-45b2-822e-0c739ef189c9 req-cdc11acc-aea2-4396-bf59-e23614e221cc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:47.027929 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cb2069cb-2138-45b2-822e-0c739ef189c9 req-cdc11acc-aea2-4396-bf59-e23614e221cc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1605484 May 20 20:31:47.072155 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cb2069cb-2138-45b2-822e-0c739ef189c9 req-9796379c-ed62-4390-85e8-0d4f56c38406 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380056 May 20 20:31:47.340284 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f09832-a25b-498a-907e-efdb634f6d45 req-e1f18f7f-122f-4c6a-a70d-6e0dc7300a21 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:47.341631 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-22f09832-a25b-498a-907e-efdb634f6d45 req-e1f18f7f-122f-4c6a-a70d-6e0dc7300a21 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 943 time: 0.0812123 May 20 20:31:47.389087 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-22f09832-a25b-498a-907e-efdb634f6d45 req-06b03201-1f00-4d85-83b5-63bf8e9de7b5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417562 May 20 20:31:47.631630 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:31:47.761678 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:47.768648 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-287bcaf6-1fcb-4c90-b401-2c51855c49e1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:47.770052 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-287bcaf6-1fcb-4c90-b401-2c51855c49e1 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.0779097 May 20 20:31:47.776050 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'port_id': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'mac_address': 'fa:16:3e:29:ca:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 840, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:31:47.833842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:47.850198 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:31:47.865400 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:47.870515 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:47.872359 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-a7ba4827-1ef1-450a-ba41-b844d850e110 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:47.920209 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Deleting port 08f701b8-1580-4323-b2f2-c088e14e4e28 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:31:47.920756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:47.936853 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=9']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:47.943870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.944207 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.944536 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.944858 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.945175 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.945495 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.945808 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.946119 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.947031 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.947339 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.947650 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.948016 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:31:47.951960 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:48.056428 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] For port 08f701b8-1580-4323-b2f2-c088e14e4e28, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=08f701b8-1580-4323-b2f2-c088e14e4e28,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:48.056781 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:48.154520 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1f7d4d2-3ccf-4fa4-bca6-777ac1484257 req-9d5bc8eb-ecab-4e24-bd12-b5b1a642b5ff tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:48.162159 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1f7d4d2-3ccf-4fa4-bca6-777ac1484257 req-9d5bc8eb-ecab-4e24-bd12-b5b1a642b5ff tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 945 time: 0.0861611 May 20 20:31:48.194895 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Calling delete_port for 08f701b8-1580-4323-b2f2-c088e14e4e28 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:31:48.205635 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1f7d4d2-3ccf-4fa4-bca6-777ac1484257 req-fd5c8818-8b2d-4e4d-8d29-c27e3603e4e0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425522 May 20 20:31:48.380962 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea07eafd-c2cf-41f7-aa30-dade79c526c4 req-08ad59bb-8767-4420-ae28-0c4ce0ad3370 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:48.382410 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea07eafd-c2cf-41f7-aa30-dade79c526c4 req-08ad59bb-8767-4420-ae28-0c4ce0ad3370 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1946645 May 20 20:31:48.449768 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:31:48.482343 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea07eafd-c2cf-41f7-aa30-dade79c526c4 req-57377361-b472-4547-a66f-b6f663db3b1e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938323 May 20 20:31:48.489197 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:48.498367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:48.553879 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event deleted for resources: {'Port': ['ID=08f701b8-1580-4323-b2f2-c088e14e4e28,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:48.557113 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:48.612527 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad69ccc-2846-4f47-862a-4688939fee5b req-84d5d4d5-beac-4559-98a3-76a5f25a32cf tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:48.614054 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fad69ccc-2846-4f47-862a-4688939fee5b req-84d5d4d5-beac-4559-98a3-76a5f25a32cf tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.0838723 May 20 20:31:48.636539 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] No DVR routers for this DVR port 08f701b8-1580-4323-b2f2-c088e14e4e28 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:31:48.638983 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:48.641558 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94b16202-270d-4a17-8756-b78db90d62eb', 'name': 'network-vif-deleted', 'tag': '08f701b8-1580-4323-b2f2-c088e14e4e28'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:31:48.658483 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9aa7b48c-3efd-4c45-b180-6fa3538f0d95 req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "DELETE /v2.0/ports/08f701b8-1580-4323-b2f2-c088e14e4e28 HTTP/1.1" status: 204 len: 173 time: 0.8688130 May 20 20:31:48.675020 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fad69ccc-2846-4f47-862a-4688939fee5b req-c3ad3ea0-1b6f-44f6-81ff-0771ab7434d3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536783 May 20 20:31:48.692863 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94b16202-270d-4a17-8756-b78db90d62eb', 'name': 'network-vif-deleted', 'tag': '08f701b8-1580-4323-b2f2-c088e14e4e28', 'status': 'completed', 'code': 200} May 20 20:31:49.366474 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-077ca90a-3760-4539-a77e-cc6842b37267 req-5cf20ceb-4865-4bec-b887-8a0a198402a7 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=94b16202-270d-4a17-8756-b78db90d62eb HTTP/1.1" status: 200 len: 210 time: 0.0435393 May 20 20:31:49.679082 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc1ccc1-093b-4c38-a7a3-1f73ec4df453 req-6f831392-0e80-4d86-83d0-34d2aa4160bc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:49.681077 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dc1ccc1-093b-4c38-a7a3-1f73ec4df453 req-6f831392-0e80-4d86-83d0-34d2aa4160bc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0855732 May 20 20:31:49.731276 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dc1ccc1-093b-4c38-a7a3-1f73ec4df453 req-ee2d13dc-cffb-4f7b-98ef-8fd677e976da tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439963 May 20 20:31:49.746475 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:31:49.874401 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a9e56d-1552-4030-ab1b-afff17e0c19a req-5111d9e8-97b7-45e7-848e-6e0cf99cc50b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:49.875888 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-22a9e56d-1552-4030-ab1b-afff17e0c19a req-5111d9e8-97b7-45e7-848e-6e0cf99cc50b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.0811794 May 20 20:31:49.924358 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-22a9e56d-1552-4030-ab1b-afff17e0c19a req-40a3e881-3244-41e7-a7c7-733edf256e56 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425458 May 20 20:31:50.922755 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d462a12d-b1b8-4ebe-bc21-4b03f8e53b4d req-6f59d68e-e7ad-489e-80fa-975b8e8edb8e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:50.924237 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d462a12d-b1b8-4ebe-bc21-4b03f8e53b4d req-6f59d68e-e7ad-489e-80fa-975b8e8edb8e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0820210 May 20 20:31:50.969748 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d462a12d-b1b8-4ebe-bc21-4b03f8e53b4d req-b48b775c-ca96-496a-970d-f8203894eb69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397890 May 20 20:31:51.122329 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16d9d0c9-4656-44d0-ac18-91b9da8e00b6 req-f8993f0e-a0ce-42a5-a371-d27c132a1300 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:51.123843 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-16d9d0c9-4656-44d0-ac18-91b9da8e00b6 req-f8993f0e-a0ce-42a5-a371-d27c132a1300 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 944 time: 0.0844047 May 20 20:31:51.177950 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-16d9d0c9-4656-44d0-ac18-91b9da8e00b6 req-2ab7b1ce-f5b6-42cc-aaec-c7929e3b189c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481987 May 20 20:31:51.683822 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:31:51.752867 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:31:51.753244 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:51.879414 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:51.909658 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:31:51.921052 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:51.925010 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:51.925997 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 08f701b8-1580-4323-b2f2-c088e14e4e28 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:31:51.954163 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:51.992423 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'code': 200} May 20 20:31:51.998640 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 08f701b8-1580-4323-b2f2-c088e14e4e28 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:31:51.998993 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 08f701b8-1580-4323-b2f2-c088e14e4e28 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:31:52.035497 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=10']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:52.038624 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:52.058212 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8663ade-6b82-428e-9083-0b104e818253 req-a9cd38d1-221f-42c2-a9a8-aba83bcce6ea tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:52.058909 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-d8663ade-6b82-428e-9083-0b104e818253 req-a9cd38d1-221f-42c2-a9a8-aba83bcce6ea tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Synchronizing usage tracker for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:31:52.075526 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-d8663ade-6b82-428e-9083-0b104e818253 req-a9cd38d1-221f-42c2-a9a8-aba83bcce6ea tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Unset dirty status for tenant:6eec95c790c84cfc8a6a2fbd90bb926c on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:31:52.076794 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8663ade-6b82-428e-9083-0b104e818253 req-a9cd38d1-221f-42c2-a9a8-aba83bcce6ea tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.0979745 May 20 20:31:52.120965 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8663ade-6b82-428e-9083-0b104e818253 req-1348ce2d-d9ed-4fc3-a833-19ad83b556c4 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384083 May 20 20:31:52.371694 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39633cca-c553-4a62-a338-e143c96d191d req-860607e7-512c-4d99-8159-be3c725e88e0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:52.373171 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-39633cca-c553-4a62-a338-e143c96d191d req-860607e7-512c-4d99-8159-be3c725e88e0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.0777986 May 20 20:31:52.420506 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-39633cca-c553-4a62-a338-e143c96d191d req-2be7c64d-be70-43bb-b8e7-df8e8001453c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417225 May 20 20:31:52.659427 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0870c7-b75a-433d-816a-222515ce9c74 req-8d4fefe7-2433-4574-b1b6-201591157527 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:52.661193 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b0870c7-b75a-433d-816a-222515ce9c74 req-8d4fefe7-2433-4574-b1b6-201591157527 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0853014 May 20 20:31:52.708250 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b0870c7-b75a-433d-816a-222515ce9c74 req-37803de6-96af-44e7-be71-1d17f8da270f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402908 May 20 20:31:52.812510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6d6a8a-c398-4271-94b4-87adc9d6db0b req-17cd2952-a5c2-41d8-a98a-167fb7b9157c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:52.813971 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6b6d6a8a-c398-4271-94b4-87adc9d6db0b req-17cd2952-a5c2-41d8-a98a-167fb7b9157c service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1099 time: 0.0694172 May 20 20:31:52.866733 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6b6d6a8a-c398-4271-94b4-87adc9d6db0b req-5ebbf447-6b54-45b9-81b4-03a33e40d7b0 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372543 May 20 20:31:53.321177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819ae923-e858-4f48-a8f7-a67f98992a72 req-7a4f59ae-06b8-479c-846e-80f23cc72fa6 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:53.323873 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-819ae923-e858-4f48-a8f7-a67f98992a72 req-7a4f59ae-06b8-479c-846e-80f23cc72fa6 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.0948143 May 20 20:31:53.372759 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-819ae923-e858-4f48-a8f7-a67f98992a72 req-202bf9a4-553f-406f-a3a9-cd291f38bc0c tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422144 May 20 20:31:53.613147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58a44cc-7bc8-478a-8367-c18c8cc7ca91 req-a54cfd94-7f52-4f49-a235-1ace7076606b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:53.614611 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f58a44cc-7bc8-478a-8367-c18c8cc7ca91 req-a54cfd94-7f52-4f49-a235-1ace7076606b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.0816386 May 20 20:31:53.659398 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f58a44cc-7bc8-478a-8367-c18c8cc7ca91 req-2ba6b493-d840-4e3f-b97f-7589b8233400 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385487 May 20 20:31:54.563222 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a343b4-0ca2-4797-bd69-5cfdc1227699 req-f18ffa94-55c6-44bb-b7fb-eeaf4182ddf2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:54.564858 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-09a343b4-0ca2-4797-bd69-5cfdc1227699 req-f18ffa94-55c6-44bb-b7fb-eeaf4182ddf2 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.0855224 May 20 20:31:54.609760 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-09a343b4-0ca2-4797-bd69-5cfdc1227699 req-a1b19a3d-6867-461a-bd06-83452beb70d6 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387640 May 20 20:31:54.855327 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d603b0c-1630-40dd-a8cd-6e7c44a0b9be req-52048105-abce-404d-b313-ecbec5c067eb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:54.856843 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3d603b0c-1630-40dd-a8cd-6e7c44a0b9be req-52048105-abce-404d-b313-ecbec5c067eb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.0849082 May 20 20:31:54.905008 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3d603b0c-1630-40dd-a8cd-6e7c44a0b9be req-7b19b28e-990d-4d98-a786-538ae0d4625c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419307 May 20 20:31:55.797335 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a04228b3-8b97-4109-9071-277cc146436e req-03641cf8-871d-421b-9cfb-a08b8b1e8cbe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:55.798703 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a04228b3-8b97-4109-9071-277cc146436e req-03641cf8-871d-421b-9cfb-a08b8b1e8cbe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.0806160 May 20 20:31:55.842849 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a04228b3-8b97-4109-9071-277cc146436e req-9984026c-2b59-4936-823d-f80ebec48bc3 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383751 May 20 20:31:55.969227 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-4f8807a7-2a11-4ac8-9a7d-00002f1e9da0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:55.970648 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-4f8807a7-2a11-4ac8-9a7d-00002f1e9da0 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 946 time: 0.0839217 May 20 20:31:56.100456 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7989e015-cf54-4500-987b-7b4d1d0635d5 req-11c8c35c-1548-4ab8-b12b-0c1d3d29c44a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:31:56.101841 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7989e015-cf54-4500-987b-7b4d1d0635d5 req-11c8c35c-1548-4ab8-b12b-0c1d3d29c44a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.0798228 May 20 20:31:56.109101 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Deleting port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:31:56.109438 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:56.146444 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7989e015-cf54-4500-987b-7b4d1d0635d5 req-78d89c0b-6686-409a-9619-62c3488c12c3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381820 May 20 20:31:56.241283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] For port 63c8bac7-63aa-4297-9795-5ceadedcdeb4, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=63c8bac7-63aa-4297-9795-5ceadedcdeb4,segment=NetworkSegment(1fc195ac-b83c-4c30-9312-57e0ea98cebc),segment_id=1fc195ac-b83c-4c30-9312-57e0ea98cebc)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:31:56.241634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:56.369167 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Calling delete_port for 63c8bac7-63aa-4297-9795-5ceadedcdeb4 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:31:56.481739 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:56.488626 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96ea7dd2-0bcc-4f71-8243-ceea8855714a tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:56.500366 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['63c8bac7-63aa-4297-9795-5ceadedcdeb4'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:31:56.607858 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Pushing event deleted for resources: {'Port': ['ID=63c8bac7-63aa-4297-9795-5ceadedcdeb4,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:56.633145 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:56.679351 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] No DVR routers for this DVR port 63c8bac7-63aa-4297-9795-5ceadedcdeb4 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:31:56.682618 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:56.685445 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5b632013-af77-4dad-bd6b-737939f436ec', 'name': 'network-vif-deleted', 'tag': '63c8bac7-63aa-4297-9795-5ceadedcdeb4'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:31:56.713186 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-48b7806e-04e4-44e4-8f1e-7df280db8b93 req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.69 "DELETE /v2.0/ports/63c8bac7-63aa-4297-9795-5ceadedcdeb4 HTTP/1.1" status: 204 len: 173 time: 0.7257197 May 20 20:31:56.733943 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b632013-af77-4dad-bd6b-737939f436ec', 'name': 'network-vif-deleted', 'tag': '63c8bac7-63aa-4297-9795-5ceadedcdeb4', 'status': 'completed', 'code': 200} May 20 20:31:57.011979 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f6bbad4a-aa73-4d4f-9f70-c25bbec5e7c5 req-e5568308-bd6c-434c-9202-dfa57dddc3a8 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] 10.222.0.82 "GET /v2.0/ports?device_id=5b632013-af77-4dad-bd6b-737939f436ec HTTP/1.1" status: 200 len: 210 time: 0.0469825 May 20 20:31:58.108057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41230) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:31:58.170667 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Deleting subnet 8debe367-8908-48d3-a2e2-6afb3c3cda2a {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:31:58.173655 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.224783 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.280311 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.532207 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.536861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:58.574655 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8debe367-8908-48d3-a2e2-6afb3c3cda2a,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:58.576854 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.579389 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:58.583408 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6c509441-7907-4ba2-aad0-4621a590cc47 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8debe367-8908-48d3-a2e2-6afb3c3cda2a HTTP/1.1" status: 204 len: 168 time: 0.4743357 May 20 20:31:58.586001 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41236) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:31:58.685621 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.808132 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.820828 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2021d324-55d7-4959-b1a9-ee3e58b34538']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:31:58.833321 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1fc195ac-b83c-4c30-9312-57e0ea98cebc') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:31:58.833601 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1fc195ac-b83c-4c30-9312-57e0ea98cebc') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:31:58.845178 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.860687 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.866930 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Releasing vlan 832 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:31:58.867291 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:31:58.880197 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:31:58.956012 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.960100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:58.975956 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:58.981998 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Pushing event deleted for resources: {'Network': ['ID=2021d324-55d7-4959-b1a9-ee3e58b34538,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:58.987645 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:58.993186 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-01abfa2f-4c1f-48ea-a4ac-32772064973f admin admin] 10.222.0.82 "DELETE /v2.0/networks/2021d324-55d7-4959-b1a9-ee3e58b34538 HTTP/1.1" status: 204 len: 168 time: 0.4059532 May 20 20:31:59.167818 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41244) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:31:59.216460 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-608ac030-223e-4c9f-9c02-6b8cbea5e62f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6eec95c790c84cfc8a6a2fbd90bb926c&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0471325 May 20 20:31:59.218831 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41248) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:31:59.275114 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:59.299969 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:59.352596 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:59.356108 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-06b34a99-b50b-4f8a-8826-287ee03572f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:31:59.369792 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a6b5f28-20eb-4bcd-8fc9-a185066d2d15,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:31:59.372597 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:31:59.379814 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:31:59.380925 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7a6b5f28-20eb-4bcd-8fc9-a185066d2d15 HTTP/1.1" status: 204 len: 168 time: 0.1612291 May 20 20:31:59.724646 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 63c8bac7-63aa-4297-9795-5ceadedcdeb4 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:31:59.762744 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 63c8bac7-63aa-4297-9795-5ceadedcdeb4 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:31:59.763097 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 63c8bac7-63aa-4297-9795-5ceadedcdeb4 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:32:00.131240 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41274) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:00.237109 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1517160630-network', 'tenant_id': '36a9a31e37f845f480b5629c68f4aa87'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:32:00.241696 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:00.245738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Usage tracker for resource:network and tenant:36a9a31e37f845f480b5629c68f4aa87 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:00.248616 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:00.258911 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:00.268511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Made reservation on behalf of 36a9a31e37f845f480b5629c68f4aa87 for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:32:00.270871 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.282938 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.296970 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:00.300749 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Usage tracker for resource:security_group_rule and tenant:36a9a31e37f845f480b5629c68f4aa87 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:00.303484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:00.309286 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:00.393215 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.398559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.403853 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f19945ac-2e4b-48d7-9d1c-3fa365ee458d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:00.428235 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] vlan segment allocate from pool success with {'vlan_id': 811, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:32:00.440716 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a888557f-124a-487b-b940-42f7c7b71f5e,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:00.444966 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:00.446434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.446793 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Added segment bd7facc8-890b-4c44-862c-d6747ffa8627 of type vlan for network 62513337-69eb-41dd-81a3-59747313677c May 20 20:32:00.474801 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.503376 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.504680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:00.505256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:00.510539 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b73a8a3-d9e2-435f-8d28-cc05f481895a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:00.603023 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.4705932 May 20 20:32:00.606062 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41280) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:00.612131 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Request body: {'subnet': {'network_id': '62513337-69eb-41dd-81a3-59747313677c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1517160630-subnet', 'tenant_id': '36a9a31e37f845f480b5629c68f4aa87', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:32:00.612350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Pushing event updated for resources: {'Network': ['ID=62513337-69eb-41dd-81a3-59747313677c,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:00.614726 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:00.616991 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:00.622007 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Usage tracker for resource:subnet and tenant:36a9a31e37f845f480b5629c68f4aa87 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:00.624333 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 62513337-69eb-41dd-81a3-59747313677c details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:32:00.624962 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:00.630885 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:00.643343 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Made reservation on behalf of 36a9a31e37f845f480b5629c68f4aa87 for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:32:00.646224 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.030573 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.035486 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2e12dad6-a2ee-4e10-984b-ccdf8fef17b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:01.108418 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6faa3dc4-5bd0-48fd-b94a-22c8ee26c474,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:01.117483 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Checking segment: {'id': 'bd7facc8-890b-4c44-862c-d6747ffa8627', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 811, 'network_id': '62513337-69eb-41dd-81a3-59747313677c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:32:01.118498 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Network hostable DHCP agents. Network: 62513337-69eb-41dd-81a3-59747313677c, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:32:01.122756 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.123121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.123477 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.123857 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.124204 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.124550 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.124895 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.125237 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.125579 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.125918 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.126253 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.126588 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:01.129958 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:01.143350 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Network 62513337-69eb-41dd-81a3-59747313677c is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:32:01.151905 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 62513337-69eb-41dd-81a3-59747313677c) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:32:01.155784 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:01.156376 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.160813 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33fe20ee-ec3b-44b9-99f1-e18126bf90d6 None None] Network 62513337-69eb-41dd-81a3-59747313677c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:32:01.177125 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f0cc0d38-c94b-463a-8d9f-b96f5ed33714 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.5698080 May 20 20:32:01.377754 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1de9b149-8dfb-4150-afaf-198c62c4c07b None None] Network 62513337-69eb-41dd-81a3-59747313677c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:32:01.723226 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41300) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:01.729217 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-983904876-network', 'tenant_id': '15fab718c9944e8e90d0987da1041676'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:32:01.733809 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:01.737573 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Usage tracker for resource:network and tenant:15fab718c9944e8e90d0987da1041676 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:01.740372 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:01.746102 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:01.756315 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Made reservation on behalf of 15fab718c9944e8e90d0987da1041676 for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:32:01.759139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.770918 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.785308 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:01.789109 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Usage tracker for resource:security_group_rule and tenant:15fab718c9944e8e90d0987da1041676 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:01.791981 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:01.797839 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:01.878954 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.884199 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.887993 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7baca21b-6ba3-4cf4-a47a-e0906601cfe6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:01.915036 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] vlan segment allocate from pool success with {'vlan_id': 838, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:32:01.927665 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b7e957a-6878-47e5-b9ac-a180f3a39a3a,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:01.931954 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:01.932908 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.933240 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Added segment e8525147-b190-40bc-8d71-ba83a72f9f70 of type vlan for network 3078668f-4a4b-462c-9b45-580bd799c2c3 May 20 20:32:01.961287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.990304 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.991653 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:01.992258 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:01.996784 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:02.172900 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.4484525 May 20 20:32:02.176177 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41306) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:02.176677 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Pushing event updated for resources: {'Network': ['ID=3078668f-4a4b-462c-9b45-580bd799c2c3,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:02.178889 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:02.184505 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Request body: {'subnet': {'network_id': '3078668f-4a4b-462c-9b45-580bd799c2c3', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-983904876-subnet', 'tenant_id': '15fab718c9944e8e90d0987da1041676', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:32:02.188643 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 3078668f-4a4b-462c-9b45-580bd799c2c3 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:32:02.200060 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:02.208652 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Usage tracker for resource:subnet and tenant:15fab718c9944e8e90d0987da1041676 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:02.212309 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:02.219264 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:02.231722 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Made reservation on behalf of 15fab718c9944e8e90d0987da1041676 for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:32:02.234527 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:02.712029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:02.716764 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:02.735990 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-3b20dcda-39df-4814-a783-3da6d4c9c0f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:02.737460 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-3b20dcda-39df-4814-a783-3da6d4c9c0f9 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1098 time: 0.1326301 May 20 20:32:02.753007 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5ca243-c395-4fcb-9035-2662b4fc8991 req-34e5b7b4-a909-4dd0-8066-00ddeb890c45 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:02.754455 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ca5ca243-c395-4fcb-9035-2662b4fc8991 req-34e5b7b4-a909-4dd0-8066-00ddeb890c45 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1133306 May 20 20:32:02.786719 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Pushing event updated for resources: {'Subnet': ['ID=3fe10838-8cad-4515-b420-7b2505dc13a1,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:02.791077 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:02.796321 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Checking segment: {'id': 'e8525147-b190-40bc-8d71-ba83a72f9f70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '3078668f-4a4b-462c-9b45-580bd799c2c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:32:02.796676 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Network hostable DHCP agents. Network: 3078668f-4a4b-462c-9b45-580bd799c2c3, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:32:02.814518 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Network 3078668f-4a4b-462c-9b45-580bd799c2c3 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:32:02.824931 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 3078668f-4a4b-462c-9b45-580bd799c2c3) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:32:02.829175 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:02.829760 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:02.834703 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3fa0806-04f6-4e54-8f1d-476d98598e5a None None] Network 3078668f-4a4b-462c-9b45-580bd799c2c3 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:32:02.849921 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.6725404 May 20 20:32:02.890965 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ca5ca243-c395-4fcb-9035-2662b4fc8991 req-e77839d6-6589-4d98-bf0a-2b38e36463a5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177015 May 20 20:32:02.927434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-2b0423c1-a048-4e2c-9010-331b4b1bc0a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:02.929113 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-2b0423c1-a048-4e2c-9010-331b4b1bc0a7 service neutron] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 919 time: 0.1733837 May 20 20:32:02.991814 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41318) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:03.020810 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-a25e8ed9-d35d-453d-9ebb-f17dc22334f4 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 200 len: 217 time: 0.0774481 May 20 20:32:03.037565 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de102f3b-b902-4cb2-9733-d96a41b2083a None None] Network 3078668f-4a4b-462c-9b45-580bd799c2c3 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:32:03.059491 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_v2 [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Deleting subnet 6faa3dc4-5bd0-48fd-b94a-22c8ee26c474 {{(pid=91645) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:32:03.062769 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.098809 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-48ce3af4-a276-49da-9e27-45be7e8f25c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:03.100284 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-48ce3af4-a276-49da-9e27-45be7e8f25c1 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.0610719 May 20 20:32:03.111922 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.119502 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.175938 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-23211c21-37a8-455c-b706-7ebde7bc21a2 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0421293 May 20 20:32:03.323198 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-632973f5-c9ef-44cd-b943-62bde2ecdfe7 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1306517 May 20 20:32:03.369313 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549'] for subnet, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.374596 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:03.408631 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6faa3dc4-5bd0-48fd-b94a-22c8ee26c474,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:03.410550 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.413203 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:03.417700 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9ba16e4c-489e-4ac2-b4f0-f59b77b6c770 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/6faa3dc4-5bd0-48fd-b94a-22c8ee26c474 HTTP/1.1" status: 204 len: 168 time: 0.4248962 May 20 20:32:03.420463 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41322) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:03.486215 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0987dc5-881f-42ef-9fcb-39d5933d332a req-0b33192c-3048-4bb5-aaf2-155dd1ba3e92 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1373301 May 20 20:32:03.527099 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.648310 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.661696 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.662035 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.662750 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.663070 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > port after_create 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.663399 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > port after_delete 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.663744 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > port after_update 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.664077 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.664385 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.664746 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.665053 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.751963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.752304 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.752630 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.752956 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=91645) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 20 20:32:03.753328 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['62513337-69eb-41dd-81a3-59747313677c']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:32:03.766847 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bd7facc8-890b-4c44-862c-d6747ffa8627') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:32:03.767140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bd7facc8-890b-4c44-862c-d6747ffa8627') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:32:03.779194 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.796306 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.803070 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Releasing vlan 811 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:32:03.803444 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: from cryptography.utils import int_from_bytes May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: from cryptography.utils import int_from_bytes May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:32:03.819170 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:32:03.900637 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.904454 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:03.920981 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:03.928501 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Pushing event deleted for resources: {'Network': ['ID=62513337-69eb-41dd-81a3-59747313677c,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:03.931880 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] 10.222.0.82 "DELETE /v2.0/networks/62513337-69eb-41dd-81a3-59747313677c HTTP/1.1" status: 204 len: 168 time: 0.5104682 May 20 20:32:03.932783 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fcdd8b09-50d0-4e50-92ab-2838098e81d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:03.934660 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41332) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:03.998849 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Deleting subnet 3fe10838-8cad-4515-b420-7b2505dc13a1 {{(pid=91645) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:32:04.002001 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.098561 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3093741'] for subnet, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.165291 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.211121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56348bd7-ac0a-4cd2-82dc-8974343cdbe6 req-29ca7a93-f36e-410e-9737-df2da1b04784 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:04.213372 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-56348bd7-ac0a-4cd2-82dc-8974343cdbe6 req-29ca7a93-f36e-410e-9737-df2da1b04784 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1842570 May 20 20:32:04.347202 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-56348bd7-ac0a-4cd2-82dc-8974343cdbe6 req-95a2d9ab-1262-482a-ade4-429a494aa718 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1266825 May 20 20:32:04.530415 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3178326', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4127932'] for subnet, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.534999 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-99930b89-fd7c-40fa-9df7-92a3a851b490 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:04.570576 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.574976 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3fe10838-8cad-4515-b420-7b2505dc13a1,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:04.577503 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:04.580251 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3fe10838-8cad-4515-b420-7b2505dc13a1 HTTP/1.1" status: 204 len: 168 time: 0.6444180 May 20 20:32:04.582718 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41336) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:04.685063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.753928 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3f6778d2-b713-4a03-84cb-4fe3f54556a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.809499 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.822186 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3078668f-4a4b-462c-9b45-580bd799c2c3']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:32:04.834791 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e8525147-b190-40bc-8d71-ba83a72f9f70') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:32:04.834791 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e8525147-b190-40bc-8d71-ba83a72f9f70') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:32:04.845952 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.861648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.867456 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Releasing vlan 838 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:32:04.868527 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:32:04.884620 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:32:04.956290 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.959860 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e4649899-9965-4511-be2a-25ad3a836357 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:04.972456 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:04.982556 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] 10.222.0.82 "DELETE /v2.0/networks/3078668f-4a4b-462c-9b45-580bd799c2c3 HTTP/1.1" status: 204 len: 168 time: 0.3989277 May 20 20:32:04.983510 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Pushing event deleted for resources: {'Network': ['ID=3078668f-4a4b-462c-9b45-580bd799c2c3,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:04.986012 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:05.153336 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41344) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:05.205532 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-ea445f6f-2a9b-4966-9f95-102340892e3d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=36a9a31e37f845f480b5629c68f4aa87&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0509367 May 20 20:32:05.208195 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41348) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:05.267395 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.293743 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.344306 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.347892 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-08895dfe-d2b3-4537-bde8-1ad780418452 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:05.359951 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a888557f-124a-487b-b940-42f7c7b71f5e,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:05.363279 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:05.366648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.368710 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a888557f-124a-487b-b940-42f7c7b71f5e HTTP/1.1" status: 204 len: 168 time: 0.1585035 May 20 20:32:05.542378 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f659ffd9-55ed-4088-8110-404e6f2a29be req-b2c3d7ee-a5eb-46a4-a2cb-cde73b06fd7e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:05.544129 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f659ffd9-55ed-4088-8110-404e6f2a29be req-b2c3d7ee-a5eb-46a4-a2cb-cde73b06fd7e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0850875 May 20 20:32:05.590765 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f659ffd9-55ed-4088-8110-404e6f2a29be req-bfb04b07-b90f-4b45-99d9-5cb9f5775bf9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392642 May 20 20:32:05.715639 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41358) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:05.764086 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-42720593-f3db-4dc7-ba3a-fb7c0e328f5f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=15fab718c9944e8e90d0987da1041676&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0471787 May 20 20:32:05.766464 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41362) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:05.825705 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.851082 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.903070 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.906642 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a72833ff-ac1a-4335-b766-b83df910426f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:05.918960 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b7e957a-6878-47e5-b9ac-a180f3a39a3a,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:05.922350 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:05.925754 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:05.929493 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2b7e957a-6878-47e5-b9ac-a180f3a39a3a HTTP/1.1" status: 204 len: 168 time: 0.1595821 May 20 20:32:06.957411 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791016b4-c24d-4e6e-8443-f14b2320d5cc req-c2d522f5-97c4-4138-b2b1-18966a4f3a54 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:06.958961 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-791016b4-c24d-4e6e-8443-f14b2320d5cc req-c2d522f5-97c4-4138-b2b1-18966a4f3a54 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.2557981 May 20 20:32:07.006870 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-791016b4-c24d-4e6e-8443-f14b2320d5cc req-44d6ff28-234e-4449-bb75-aabf4f4db07d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419343 May 20 20:32:07.216032 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:07.485008 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c2840a26-e719-49ef-9334-df9cff7fd9ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:08.270350 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:08.374203 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cbee1a-c477-4475-bbc7-09a13d808865 req-7ead509a-7dd5-4db1-aac9-b26df2f21016 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:08.375666 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66cbee1a-c477-4475-bbc7-09a13d808865 req-7ead509a-7dd5-4db1-aac9-b26df2f21016 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.2592721 May 20 20:32:08.420842 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66cbee1a-c477-4475-bbc7-09a13d808865 req-4e8a9d78-b765-48ae-8762-c609891c6de5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392528 May 20 20:32:09.615976 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675d1634-903a-45b0-ae66-5ebfd568d20c req-10845a80-5565-45a5-a741-09fa9b433f24 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:09.617452 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-675d1634-903a-45b0-ae66-5ebfd568d20c req-10845a80-5565-45a5-a741-09fa9b433f24 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0842862 May 20 20:32:09.661848 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-675d1634-903a-45b0-ae66-5ebfd568d20c req-386cbcc5-7f92-4f0b-a0f0-37abdab6073f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386310 May 20 20:32:09.895526 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:10.710330 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41466) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:10.830618 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:10.845759 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:10.849239 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e5d889-9f41-451d-8b9d-e00d0391fe42 req-3a14ea1d-5c05-4465-a52f-3e8108346ed6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:10.849726 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Usage tracker for resource:security_group_rule and tenant:64f1abf592be4db7bf20e8e6abb91ccd is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:10.850994 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-65e5d889-9f41-451d-8b9d-e00d0391fe42 req-3a14ea1d-5c05-4465-a52f-3e8108346ed6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0829632 May 20 20:32:10.852965 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:10.858692 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:10.901098 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-65e5d889-9f41-451d-8b9d-e00d0391fe42 req-ec148046-f449-4651-b016-0f9ffed029cd tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424826 May 20 20:32:10.948799 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:10.952969 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:10.964771 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b4fbbae1-b4b0-43e8-b880-eeb6c9fbb3d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:11.004106 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=64f1abf592be4db7bf20e8e6abb91ccd&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2926915 May 20 20:32:11.005719 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=473d9170-4174-47af-889e-435cab0c0b47,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:11.006896 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41472) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:11.009119 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:11.069903 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.095102 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.145926 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.150386 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dfa6cecc-a8da-4c71-aebb-677eba24b3b2 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:11.160754 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=473d9170-4174-47af-889e-435cab0c0b47,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:11.164522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:11.168757 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.169847 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/473d9170-4174-47af-889e-435cab0c0b47 HTTP/1.1" status: 204 len: 168 time: 0.1619983 May 20 20:32:11.447871 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41480) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:11.466225 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.480441 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:11.484186 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Usage tracker for resource:security_group_rule and tenant:f91f51fa72db4fc69c2f6ae91ba5579b is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:11.486892 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:11.492455 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:11.576905 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.580556 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.588647 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2b00ba54-3d52-43bf-af3a-8ae6fc30ffd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:11.629133 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f91f51fa72db4fc69c2f6ae91ba5579b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1802826 May 20 20:32:11.630146 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7bc44b5-9251-4580-86df-3f4b5088ae14,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:11.631827 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41484) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:11.633197 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f675c76e-d948-4a4f-a733-86d3058b4556 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:11.691357 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.716634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.767904 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.771668 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5ff8cc5e-9584-49ac-b09c-290bdf829446 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:11.782442 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7bc44b5-9251-4580-86df-3f4b5088ae14,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:11.786193 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:11.790453 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:11.792065 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b7bc44b5-9251-4580-86df-3f4b5088ae14 HTTP/1.1" status: 204 len: 168 time: 0.1589975 May 20 20:32:12.097982 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9369462a-ddfe-4a39-899c-453aae6e2a8f req-33d4dedf-9398-4f7a-908b-dfe9c749be49 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:12.099438 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9369462a-ddfe-4a39-899c-453aae6e2a8f req-33d4dedf-9398-4f7a-908b-dfe9c749be49 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0903165 May 20 20:32:12.150499 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9369462a-ddfe-4a39-899c-453aae6e2a8f req-8344ddfe-a12c-46b9-960f-eb5d883b7ae2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439830 May 20 20:32:13.344572 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85306fad-bf80-4210-b31b-efc101e85272 req-5b5e77ff-063a-473b-9178-b5d32286fd28 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:13.346012 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-85306fad-bf80-4210-b31b-efc101e85272 req-5b5e77ff-063a-473b-9178-b5d32286fd28 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0846190 May 20 20:32:13.391339 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-85306fad-bf80-4210-b31b-efc101e85272 req-19e81920-6e0b-4a54-83f3-e4c3ebfc6e42 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392821 May 20 20:32:14.577446 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e433406-a199-413c-96c8-59a3fe1be31d req-6c1bb2cd-d89d-4c86-8e16-b50911e37050 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:14.578825 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4e433406-a199-413c-96c8-59a3fe1be31d req-6c1bb2cd-d89d-4c86-8e16-b50911e37050 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0803945 May 20 20:32:14.626354 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4e433406-a199-413c-96c8-59a3fe1be31d req-8f894bbc-694b-44b2-aba8-4a3ae7c6d412 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418551 May 20 20:32:15.006296 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:15.812290 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d22340-c982-4911-8c5e-444c8003f82c req-edb04991-db6d-478e-b22d-481fe1fb1876 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:15.813762 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-03d22340-c982-4911-8c5e-444c8003f82c req-edb04991-db6d-478e-b22d-481fe1fb1876 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0824993 May 20 20:32:15.857637 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-03d22340-c982-4911-8c5e-444c8003f82c req-d35ad234-873a-4771-8003-69a83b58b226 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381618 May 20 20:32:17.046338 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb10646-2a39-45b1-baaf-4901590ca440 req-ef4a964d-ea22-422a-a029-8cd375cba1b8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:17.047860 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dfb10646-2a39-45b1-baaf-4901590ca440 req-ef4a964d-ea22-422a-a029-8cd375cba1b8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0804269 May 20 20:32:17.092724 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dfb10646-2a39-45b1-baaf-4901590ca440 req-5c668cff-ea1a-47c0-bded-7c9f9355b17b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390801 May 20 20:32:18.280795 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c0d47b-b55c-48a9-896c-5a67820397dc req-3b204def-e79b-45b2-8f2a-cdb762825b2e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:18.282253 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-67c0d47b-b55c-48a9-896c-5a67820397dc req-3b204def-e79b-45b2-8f2a-cdb762825b2e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0806911 May 20 20:32:18.326690 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-67c0d47b-b55c-48a9-896c-5a67820397dc req-e7ef2eb5-7c46-499e-a169-be0150d54898 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387948 May 20 20:32:19.294440 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c196964-127c-4e83-acc9-20ca5d32317e req-56f995fc-1bed-4126-8350-b5b4b6c02f43 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:19.295898 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8c196964-127c-4e83-acc9-20ca5d32317e req-56f995fc-1bed-4126-8350-b5b4b6c02f43 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.1640656 May 20 20:32:19.342595 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8c196964-127c-4e83-acc9-20ca5d32317e req-b35e3d9a-4d30-4688-a875-3bf6484a7e81 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0406399 May 20 20:32:19.666071 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52eda410-a72f-4013-afca-9ec9ef5423bf req-4e37b68c-e8b5-4407-89fa-ab729c0d7cf7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:19.667504 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-52eda410-a72f-4013-afca-9ec9ef5423bf req-4e37b68c-e8b5-4407-89fa-ab729c0d7cf7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0823653 May 20 20:32:19.712874 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-52eda410-a72f-4013-afca-9ec9ef5423bf req-40144138-0607-42c8-9814-52b6a33edda7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392878 May 20 20:32:20.267693 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-02392f5e-52e8-4de9-9f61-8aceecb7430b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:20.269242 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-02392f5e-52e8-4de9-9f61-8aceecb7430b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1137 time: 0.0707600 May 20 20:32:20.409111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-77e66348-7673-4f17-ab0d-5950c750d4c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:20.410543 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-77e66348-7673-4f17-ab0d-5950c750d4c8 service neutron] 10.222.0.69 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 915 time: 0.1270289 May 20 20:32:20.571671 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-35f286d4-6c6c-40e4-bd96-ce34e9c0d23b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 1001 time: 0.1505008 May 20 20:32:20.594388 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2189035d-bd63-4a56-bcfa-392ca23ec8a2 req-b503295a-81f3-4482-96ce-c102489fedcb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:20.595811 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2189035d-bd63-4a56-bcfa-392ca23ec8a2 req-b503295a-81f3-4482-96ce-c102489fedcb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.1186526 May 20 20:32:20.686982 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-44acabee-f153-4342-a64b-662e7c25277b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:20.688476 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-44acabee-f153-4342-a64b-662e7c25277b service neutron] 10.222.0.69 "GET /v2.0/subnets?id=cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 200 len: 853 time: 0.0918405 May 20 20:32:20.692531 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2189035d-bd63-4a56-bcfa-392ca23ec8a2 req-f06a954c-cf9e-4624-a800-9fcdb59ecb42 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0664475 May 20 20:32:20.767536 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-66c0f6ec-438f-4462-b757-097edb038255 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:20.769297 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-66c0f6ec-438f-4462-b757-097edb038255 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0708723 May 20 20:32:20.899878 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b0889d-0e04-4554-8018-51781708cce8 req-ff5a4c75-7ace-42fe-96b9-0f0e5ae348c2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:20.901577 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44b0889d-0e04-4554-8018-51781708cce8 req-ff5a4c75-7ace-42fe-96b9-0f0e5ae348c2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0790679 May 20 20:32:20.908906 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-56ff1126-996e-4437-88b2-ec7a85d424df service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1252844 May 20 20:32:20.949086 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44b0889d-0e04-4554-8018-51781708cce8 req-bb518ceb-5eec-442a-b3f9-3e838822ff69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418780 May 20 20:32:21.048329 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7e904f40-0ac3-4bc5-8241-ed05d7b8dc77 req-92a7f547-099b-41b4-b522-df4f52aa5249 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1235037 May 20 20:32:21.810659 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:32:21.895820 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2952fa30-5c43-4524-8725-f5d2803c2422 req-71a616a2-7fc6-40d7-b422-bc5dedafe5a6 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:21.897279 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2952fa30-5c43-4524-8725-f5d2803c2422 req-71a616a2-7fc6-40d7-b422-bc5dedafe5a6 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0834374 May 20 20:32:21.948947 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2952fa30-5c43-4524-8725-f5d2803c2422 req-b51a6cd5-6535-4e33-a4a8-f71aea92b4b9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0451021 May 20 20:32:22.134085 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd24d2e-3ac9-4735-ac5b-8859c86c21d1 req-db999f53-34b5-46a3-8e55-9aa43ab18002 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:22.135535 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5cd24d2e-3ac9-4735-ac5b-8859c86c21d1 req-db999f53-34b5-46a3-8e55-9aa43ab18002 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0790589 May 20 20:32:22.179411 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5cd24d2e-3ac9-4735-ac5b-8859c86c21d1 req-828c4a9f-b106-4bee-b9a0-37ad1e8dd0b7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381179 May 20 20:32:23.137716 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92babc3d-75c4-46c2-ad9e-3d9dde958e92 req-1213a4df-0225-4628-a141-331820a464cb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:23.139145 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-92babc3d-75c4-46c2-ad9e-3d9dde958e92 req-1213a4df-0225-4628-a141-331820a464cb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0795236 May 20 20:32:23.185907 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-92babc3d-75c4-46c2-ad9e-3d9dde958e92 req-902710f2-4a56-42e6-b5cd-b759516a1b4c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0408542 May 20 20:32:23.370611 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2090562e-c045-4146-91a7-5ee5c2af081d req-a7cad2e6-96b8-41d4-a91b-0b73699342a8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:23.372087 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2090562e-c045-4146-91a7-5ee5c2af081d req-a7cad2e6-96b8-41d4-a91b-0b73699342a8 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0841064 May 20 20:32:23.480373 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2090562e-c045-4146-91a7-5ee5c2af081d req-9e00d5df-f7a4-46d8-98ea-87b52608e053 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025283 May 20 20:32:24.373495 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53d32741-511f-4962-81c7-500379c8bbdc req-114c53a9-4c3a-418d-a0e7-cf7fef6fe61e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:24.374936 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-53d32741-511f-4962-81c7-500379c8bbdc req-114c53a9-4c3a-418d-a0e7-cf7fef6fe61e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0830266 May 20 20:32:24.420825 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-53d32741-511f-4962-81c7-500379c8bbdc req-ce28df2b-02ef-46f9-9a76-83174dd6e0be tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0401161 May 20 20:32:24.662050 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd72a6e-c18b-4a7a-93a9-cb515fb611d1 req-6ba04f2f-ffa8-439f-8ae2-f504d2d5dd99 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:24.663498 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1bd72a6e-c18b-4a7a-93a9-cb515fb611d1 req-6ba04f2f-ffa8-439f-8ae2-f504d2d5dd99 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0801008 May 20 20:32:24.711968 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1bd72a6e-c18b-4a7a-93a9-cb515fb611d1 req-ca23e46e-a206-4bb7-9acf-c3c9403a168c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412483 May 20 20:32:25.604619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-214ddc18-59dc-4913-8bd0-25e074c1fd4d req-6fd8c670-7a90-456c-9cc4-bf2df03bb3ae tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:25.606051 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-214ddc18-59dc-4913-8bd0-25e074c1fd4d req-6fd8c670-7a90-456c-9cc4-bf2df03bb3ae tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0777669 May 20 20:32:25.655609 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-214ddc18-59dc-4913-8bd0-25e074c1fd4d req-1105c65d-ae60-43c7-84a0-bd34d3b70d54 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0418866 May 20 20:32:25.897142 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45cd815e-9f44-4fb9-b03b-ff2245c65afe req-ce8f19ab-08a4-4d67-b2ba-060472fd090e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:25.898599 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-45cd815e-9f44-4fb9-b03b-ff2245c65afe req-ce8f19ab-08a4-4d67-b2ba-060472fd090e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0798762 May 20 20:32:25.943240 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-45cd815e-9f44-4fb9-b03b-ff2245c65afe req-1aaa24fc-ba71-40bb-815c-2b83d89633a0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379877 May 20 20:32:26.849802 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23fdf971-73b4-43f6-bfa4-969c80cf1b1b req-a9547084-8327-4b74-a843-2f647e552f9d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:26.851241 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-23fdf971-73b4-43f6-bfa4-969c80cf1b1b req-a9547084-8327-4b74-a843-2f647e552f9d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0827556 May 20 20:32:26.898422 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-23fdf971-73b4-43f6-bfa4-969c80cf1b1b req-10f4d445-5404-4e52-ada1-b38d3146480d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0412672 May 20 20:32:27.136267 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeca3f0b-7b65-423f-bf0d-1a70a956f47c req-97006fb0-ccbb-4137-beeb-f9eeb2440025 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:27.137728 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eeca3f0b-7b65-423f-bf0d-1a70a956f47c req-97006fb0-ccbb-4137-beeb-f9eeb2440025 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0855527 May 20 20:32:27.182693 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eeca3f0b-7b65-423f-bf0d-1a70a956f47c req-952daec5-9c7e-4b3e-8e18-930d303090db tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392277 May 20 20:32:28.089331 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df584a7a-3264-46da-a50e-c36d98228a99 req-83b28efe-7e7f-4034-b7cf-d70ac076e093 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:28.090821 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-df584a7a-3264-46da-a50e-c36d98228a99 req-83b28efe-7e7f-4034-b7cf-d70ac076e093 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0861473 May 20 20:32:28.138603 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-df584a7a-3264-46da-a50e-c36d98228a99 req-662f9beb-0446-4958-b589-45d8732c5271 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0420024 May 20 20:32:28.372435 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-defcced6-08c5-4455-a4fd-6664f921f366 req-99dd566b-c493-4abf-acd7-d90e0328a8f9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:28.373921 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-defcced6-08c5-4455-a4fd-6664f921f366 req-99dd566b-c493-4abf-acd7-d90e0328a8f9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0810683 May 20 20:32:28.419183 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-defcced6-08c5-4455-a4fd-6664f921f366 req-3dc50040-ad9b-4766-9337-7cc78bf80881 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395405 May 20 20:32:29.326484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4899dc-28e9-40f7-b254-1823eeedcd0e req-3ddf5112-e049-42d6-bdfa-301fad8773c8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:29.327949 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7c4899dc-28e9-40f7-b254-1823eeedcd0e req-3ddf5112-e049-42d6-bdfa-301fad8773c8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0794923 May 20 20:32:29.375223 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7c4899dc-28e9-40f7-b254-1823eeedcd0e req-74c54b9f-4b36-4000-b5ba-b9e6a7f755d1 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0414822 May 20 20:32:29.608976 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-050f0e8e-b2ca-4cce-8cd6-1766c7b5c91f req-84c246b0-59a9-48d3-940b-542107b66790 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:29.610478 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-050f0e8e-b2ca-4cce-8cd6-1766c7b5c91f req-84c246b0-59a9-48d3-940b-542107b66790 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0835624 May 20 20:32:29.658453 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-050f0e8e-b2ca-4cce-8cd6-1766c7b5c91f req-ce7ac0d6-ff64-47d2-b7b6-0690de91e5df tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424135 May 20 20:32:30.642527 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b2516c-27b6-4702-b407-4847c128a8d0 req-0435c9b5-c243-40b0-9d72-9d090954eabe tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:30.644013 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-04b2516c-27b6-4702-b407-4847c128a8d0 req-0435c9b5-c243-40b0-9d72-9d090954eabe tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.1593599 May 20 20:32:30.690858 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-04b2516c-27b6-4702-b407-4847c128a8d0 req-5058870f-adbc-4fe5-ac12-a118a2e0f67d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0407906 May 20 20:32:30.844377 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5492a61c-394a-45b7-8eab-e077c5197ec3 req-aa61d2b0-7266-434b-bd11-a29c2a38eadf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:30.845844 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5492a61c-394a-45b7-8eab-e077c5197ec3 req-aa61d2b0-7266-434b-bd11-a29c2a38eadf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0793536 May 20 20:32:30.893880 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5492a61c-394a-45b7-8eab-e077c5197ec3 req-03e47bcc-e2da-429d-a6bf-53245799af3a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422730 May 20 20:32:31.876217 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd2fdba-b8c3-4baf-b370-6cd4a58c0715 req-480f057c-c4d3-4136-9579-77a0aa09027d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:31.877656 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dd2fdba-b8c3-4baf-b370-6cd4a58c0715 req-480f057c-c4d3-4136-9579-77a0aa09027d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0820134 May 20 20:32:31.934111 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9dd2fdba-b8c3-4baf-b370-6cd4a58c0715 req-c886c0d2-3436-47e8-aceb-81810b213583 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0501065 May 20 20:32:32.080197 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c6713a-a4e0-4b56-8fe7-430b0ffe5cfa req-10e0fdac-a4a2-43b7-beb0-055b207c3c00 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:32.081561 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-03c6713a-a4e0-4b56-8fe7-430b0ffe5cfa req-10e0fdac-a4a2-43b7-beb0-055b207c3c00 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0807483 May 20 20:32:32.127866 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-03c6713a-a4e0-4b56-8fe7-430b0ffe5cfa req-086756c2-34ff-4667-a2c1-a81976d5baa9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403926 May 20 20:32:33.118908 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d32a625-a451-4185-954c-073743152dc4 req-f3344f97-99fb-4b2e-9be9-8f82312de428 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:33.120394 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d32a625-a451-4185-954c-073743152dc4 req-f3344f97-99fb-4b2e-9be9-8f82312de428 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0814891 May 20 20:32:33.169285 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d32a625-a451-4185-954c-073743152dc4 req-b285f633-c4ef-4355-a1eb-e021d4bc6a9c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0430210 May 20 20:32:33.318593 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731cba22-7c9d-4f92-b251-4ff316468c35 req-c84440d6-04bb-45ad-8de7-8e6b7a3cbd62 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:33.320072 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-731cba22-7c9d-4f92-b251-4ff316468c35 req-c84440d6-04bb-45ad-8de7-8e6b7a3cbd62 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0847709 May 20 20:32:33.364602 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-731cba22-7c9d-4f92-b251-4ff316468c35 req-eefa49e3-bad0-442a-b986-d601e7dcfea6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386665 May 20 20:32:34.360954 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5bbb009-0dbd-42cf-a74f-19fb31ed5276 req-8c823df7-9fe3-4abc-a614-202b26f14686 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:34.362397 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a5bbb009-0dbd-42cf-a74f-19fb31ed5276 req-8c823df7-9fe3-4abc-a614-202b26f14686 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0839655 May 20 20:32:34.410440 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a5bbb009-0dbd-42cf-a74f-19fb31ed5276 req-98ed1bd7-115d-4bdd-babf-e41d1510846e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0415971 May 20 20:32:34.553923 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95eaeacb-c0b3-433a-b193-a3910d8343d6 req-a5285c46-2fec-43bf-9ee7-0ee9ba9743bb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:34.555751 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-95eaeacb-c0b3-433a-b193-a3910d8343d6 req-a5285c46-2fec-43bf-9ee7-0ee9ba9743bb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0815749 May 20 20:32:34.600196 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-95eaeacb-c0b3-433a-b193-a3910d8343d6 req-2a2ccabb-2f35-40b9-9cdf-0444362480af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387273 May 20 20:32:34.755177 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-043fdd3d-7e66-41ee-ba0b-d1a0f9c3636b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:35.595832 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe709139-33de-474e-8d8c-754f6e1012df req-1f0de931-a9a9-42c2-a057-bd35ca4aca7b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:35.597198 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fe709139-33de-474e-8d8c-754f6e1012df req-1f0de931-a9a9-42c2-a057-bd35ca4aca7b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0810299 May 20 20:32:35.645137 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fe709139-33de-474e-8d8c-754f6e1012df req-9f7055fa-b08e-4306-8c93-64e4e726329f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0415916 May 20 20:32:35.792170 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ec53d4-8513-4d35-bcc5-9fd611dbfb50 req-bce32416-59fe-474f-b8ac-e9a85a9acd6f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:35.793892 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11ec53d4-8513-4d35-bcc5-9fd611dbfb50 req-bce32416-59fe-474f-b8ac-e9a85a9acd6f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0848246 May 20 20:32:35.838604 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-11ec53d4-8513-4d35-bcc5-9fd611dbfb50 req-d69b2e13-1716-49ff-97ee-86a3d87680ee tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389631 May 20 20:32:36.834451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb4bd339-e5bf-470e-b394-a0860a82889f req-684eb9cf-a774-462f-bc2a-65f2cef4dd2a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:36.835903 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fb4bd339-e5bf-470e-b394-a0860a82889f req-684eb9cf-a774-462f-bc2a-65f2cef4dd2a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0819485 May 20 20:32:36.882351 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fb4bd339-e5bf-470e-b394-a0860a82889f req-e1d274f0-dd50-4b91-b251-ebc1e5f5fbfa tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0401061 May 20 20:32:37.025715 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f017e062-55a8-4d4d-98d9-358eee53945c req-95f9f6c2-f6b8-40b1-aeba-118bd2e70cdf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:37.027082 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f017e062-55a8-4d4d-98d9-358eee53945c req-95f9f6c2-f6b8-40b1-aeba-118bd2e70cdf tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0779510 May 20 20:32:37.075229 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f017e062-55a8-4d4d-98d9-358eee53945c req-fd64e082-f645-44f4-a0c0-0ff4bb5fce9d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423906 May 20 20:32:37.210407 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:37.487286 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-aab6f056-5acb-4147-951f-c228b323658a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:38.075093 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6cc5c7-b42e-4a4f-ab64-a6a120592379 req-692ba912-be22-4f4e-9ac4-6984108219a6 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:38.076570 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bd6cc5c7-b42e-4a4f-ab64-a6a120592379 req-692ba912-be22-4f4e-9ac4-6984108219a6 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0810761 May 20 20:32:38.127738 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bd6cc5c7-b42e-4a4f-ab64-a6a120592379 req-f22bbb71-2993-45ec-90d8-2c46cb4f0ed4 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0452840 May 20 20:32:38.260857 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c92fdd-9096-40e5-902d-8a1966788f39 req-684276c0-ed2e-4e4c-95ea-9c0202981f80 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:38.262356 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-78c92fdd-9096-40e5-902d-8a1966788f39 req-684276c0-ed2e-4e4c-95ea-9c0202981f80 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0793502 May 20 20:32:38.274781 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:38.308129 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-78c92fdd-9096-40e5-902d-8a1966788f39 req-b9d56e18-9e3e-4284-96fb-23b5a5151790 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401297 May 20 20:32:39.315937 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23d97a5-19bf-434f-a1df-914cd1cc405b req-736469ea-3815-46ac-817b-cbdbc58dde60 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:39.317384 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b23d97a5-19bf-434f-a1df-914cd1cc405b req-736469ea-3815-46ac-817b-cbdbc58dde60 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0808861 May 20 20:32:39.365424 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b23d97a5-19bf-434f-a1df-914cd1cc405b req-a78dc51d-0e35-4f74-bcc8-3ce178856272 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0416574 May 20 20:32:39.501431 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ff3342-1288-4c1e-9be2-ef9c60fd00cf req-7dde7318-06d6-47d2-ade6-6ed61be9fe9d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:39.502784 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-99ff3342-1288-4c1e-9be2-ef9c60fd00cf req-7dde7318-06d6-47d2-ade6-6ed61be9fe9d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0888691 May 20 20:32:39.547534 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-99ff3342-1288-4c1e-9be2-ef9c60fd00cf req-3a50b88b-883a-4c91-85d5-74c49809676a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390854 May 20 20:32:39.896693 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:40.556603 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c88170-d9cc-4ef2-8aad-908462216945 req-8e715a6a-2bde-4d22-9789-a86da9c8465e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:40.557958 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e8c88170-d9cc-4ef2-8aad-908462216945 req-8e715a6a-2bde-4d22-9789-a86da9c8465e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0848322 May 20 20:32:40.605272 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e8c88170-d9cc-4ef2-8aad-908462216945 req-4b8d23a2-6708-482d-b02f-734154f948d2 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0415037 May 20 20:32:40.734012 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aad59e9-c1aa-44f1-8b8f-638e7c7a3b51 req-1888131d-4f47-4b31-8d5f-7d4a896cf0a4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:40.735448 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0aad59e9-c1aa-44f1-8b8f-638e7c7a3b51 req-1888131d-4f47-4b31-8d5f-7d4a896cf0a4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0807989 May 20 20:32:40.781768 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0aad59e9-c1aa-44f1-8b8f-638e7c7a3b51 req-a9500402-d807-4abe-b666-f4101f854fda tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404608 May 20 20:32:41.793363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2502b07-3103-44f3-bc6f-35149f342f61 req-dbaf1477-edad-4aab-a539-60b163ae6d23 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:41.794828 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a2502b07-3103-44f3-bc6f-35149f342f61 req-dbaf1477-edad-4aab-a539-60b163ae6d23 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0812438 May 20 20:32:41.843548 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a2502b07-3103-44f3-bc6f-35149f342f61 req-d14171a7-b558-474d-9dab-01d160fae71b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0430133 May 20 20:32:41.991281 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d53c30-e0b1-4cff-ae97-c02a6f36ed1b req-910d84f2-a27c-4e21-9a32-4d13b016c6ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:41.993186 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d8d53c30-e0b1-4cff-ae97-c02a6f36ed1b req-910d84f2-a27c-4e21-9a32-4d13b016c6ca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0987358 May 20 20:32:42.037208 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d8d53c30-e0b1-4cff-ae97-c02a6f36ed1b req-ba00ee57-4501-4758-9f34-2949647ed247 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387607 May 20 20:32:43.031841 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52408e0f-dd3c-4eb3-ad1e-592570e645b5 req-a47654c8-3e36-4a18-8009-d48d771d8ee1 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:43.033275 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-52408e0f-dd3c-4eb3-ad1e-592570e645b5 req-a47654c8-3e36-4a18-8009-d48d771d8ee1 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0832975 May 20 20:32:43.081116 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-52408e0f-dd3c-4eb3-ad1e-592570e645b5 req-0bc75301-5d81-485a-b84d-c1df1aeabf12 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0419602 May 20 20:32:43.220606 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276da312-56c1-4014-ae93-0d18e7a58284 req-7d3f334f-0811-462a-afc3-3615ec4b6b72 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:43.222097 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-276da312-56c1-4014-ae93-0d18e7a58284 req-7d3f334f-0811-462a-afc3-3615ec4b6b72 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0795097 May 20 20:32:43.269285 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-276da312-56c1-4014-ae93-0d18e7a58284 req-4bed40c9-f7ae-48f3-978d-9456eb5a1a56 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413234 May 20 20:32:44.270283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a357289c-27d6-4540-a624-be30dd26addc req-4b400b21-c69c-4c07-bbdc-44a7cd7fc0fa tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:44.271638 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a357289c-27d6-4540-a624-be30dd26addc req-4b400b21-c69c-4c07-bbdc-44a7cd7fc0fa tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0816562 May 20 20:32:44.319590 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a357289c-27d6-4540-a624-be30dd26addc req-86b29909-ac33-493b-8258-f443060ec790 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0414953 May 20 20:32:44.456461 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3fe86a-dcd5-4011-a0cf-8ab199aa096d req-c1c16577-0877-4778-abd9-280f8181ca69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:44.457987 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1c3fe86a-dcd5-4011-a0cf-8ab199aa096d req-c1c16577-0877-4778-abd9-280f8181ca69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0831699 May 20 20:32:44.503669 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1c3fe86a-dcd5-4011-a0cf-8ab199aa096d req-faa99add-c8db-462c-a895-6989f1ee6ce5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389230 May 20 20:32:45.019080 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:45.528321 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8398aa0c-d27f-4f50-9b37-b97179c53d23 req-55c6c90f-78df-468d-b038-0a0838e10a92 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:45.528926 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8398aa0c-d27f-4f50-9b37-b97179c53d23 req-55c6c90f-78df-468d-b038-0a0838e10a92 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.1013308 May 20 20:32:45.594969 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8398aa0c-d27f-4f50-9b37-b97179c53d23 req-c7bd6342-6b13-4cd1-9fef-f908ac986e21 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0584538 May 20 20:32:45.701635 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b07209-f591-44cd-aafe-6a127a332b32 req-67d26f63-095b-4376-816b-712d3795a785 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:45.703055 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f1b07209-f591-44cd-aafe-6a127a332b32 req-67d26f63-095b-4376-816b-712d3795a785 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0826199 May 20 20:32:45.815561 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f1b07209-f591-44cd-aafe-6a127a332b32 req-3ae939f0-39d0-42eb-993f-3061ae37039a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066420 May 20 20:32:46.922222 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0641f48e-be15-4e1e-a098-94816f899871 req-5b9219b3-589b-4581-80d7-5da41854cea4 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:46.923689 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0641f48e-be15-4e1e-a098-94816f899871 req-5b9219b3-589b-4581-80d7-5da41854cea4 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0880725 May 20 20:32:46.971010 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0641f48e-be15-4e1e-a098-94816f899871 req-bfbdc075-3e6c-46aa-8912-87cee9bc5717 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0414543 May 20 20:32:47.003220 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6f5a87-9346-4a91-830a-8570e05bafba req-b278ca92-9537-4282-94de-f16bdf39eaca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:47.004767 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a6f5a87-9346-4a91-830a-8570e05bafba req-b278ca92-9537-4282-94de-f16bdf39eaca tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0809124 May 20 20:32:47.052219 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a6f5a87-9346-4a91-830a-8570e05bafba req-1d006b24-a2f9-4438-beae-191e88f2821a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413334 May 20 20:32:48.159268 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5462e64a-bffd-4de5-a869-655b14fdfbb1 req-b174295b-4e63-4618-a62e-9d9ec33f013c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:48.160789 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5462e64a-bffd-4de5-a869-655b14fdfbb1 req-b174295b-4e63-4618-a62e-9d9ec33f013c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0801740 May 20 20:32:48.218421 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5462e64a-bffd-4de5-a869-655b14fdfbb1 req-7a222422-09a3-46d4-8ef0-32e6c6f1cfc5 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0512865 May 20 20:32:48.244264 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c033301-96d8-44dc-8090-91ff18ca6b46 req-e9f6f3e6-217f-4ae5-854f-a6b35d878614 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:48.245796 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6c033301-96d8-44dc-8090-91ff18ca6b46 req-e9f6f3e6-217f-4ae5-854f-a6b35d878614 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0871959 May 20 20:32:48.290636 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6c033301-96d8-44dc-8090-91ff18ca6b46 req-a6ac0fb6-30ef-485c-8824-d704d8700b7c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389354 May 20 20:32:49.407080 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08f53cb3-0593-45b1-b49e-bbb83cb54077 req-71db3fb1-b5e5-4e08-84d4-2cc60f3faad0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:49.408571 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-08f53cb3-0593-45b1-b49e-bbb83cb54077 req-71db3fb1-b5e5-4e08-84d4-2cc60f3faad0 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0820286 May 20 20:32:49.455305 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-08f53cb3-0593-45b1-b49e-bbb83cb54077 req-02cba15b-a30d-453a-a129-277fd1bbbbdb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0400558 May 20 20:32:49.488464 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64968ff0-9be4-4937-a4f6-cf7a854271fa req-7a866e24-d14b-443f-9600-bb1d213a36f6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:49.489890 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-64968ff0-9be4-4937-a4f6-cf7a854271fa req-7a866e24-d14b-443f-9600-bb1d213a36f6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0915098 May 20 20:32:49.543707 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-64968ff0-9be4-4937-a4f6-cf7a854271fa req-01c22976-8fc0-488b-9c4b-1d4bd4893a53 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467277 May 20 20:32:50.642608 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ccaa09-1155-40d4-bd5b-8c77f4ada838 req-e5d90c52-2f62-44ee-8bc5-702a1cf02a13 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:50.644074 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-12ccaa09-1155-40d4-bd5b-8c77f4ada838 req-e5d90c52-2f62-44ee-8bc5-702a1cf02a13 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0847759 May 20 20:32:50.690712 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-12ccaa09-1155-40d4-bd5b-8c77f4ada838 req-17309cc6-b73b-478b-8f54-d8dc96460e5f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0402248 May 20 20:32:50.728770 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8624f-eb99-4ca7-a0a4-0787a223516d req-aab81515-821d-4cea-8399-374c50ffabd6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:50.730232 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-69a8624f-eb99-4ca7-a0a4-0787a223516d req-aab81515-821d-4cea-8399-374c50ffabd6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0802116 May 20 20:32:50.775966 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-69a8624f-eb99-4ca7-a0a4-0787a223516d req-2407e8d1-c033-4eb1-874f-33cea0bf4b50 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400138 May 20 20:32:51.883388 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec33bc4-472b-4c3e-b041-ba396fb1675e req-840e37f3-24c8-48af-9b3f-0c3c0d16555c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:51.888221 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7ec33bc4-472b-4c3e-b041-ba396fb1675e req-840e37f3-24c8-48af-9b3f-0c3c0d16555c tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0886333 May 20 20:32:51.942128 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7ec33bc4-472b-4c3e-b041-ba396fb1675e req-dc7ec57b-bb16-439b-ac98-2a384445a433 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0513291 May 20 20:32:51.985654 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea751d0-fe6c-48db-a1b8-93011dffe01d req-553f9458-0c0f-46b0-b456-aef1eff75503 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:51.995297 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eea751d0-fe6c-48db-a1b8-93011dffe01d req-553f9458-0c0f-46b0-b456-aef1eff75503 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0994294 May 20 20:32:52.048400 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eea751d0-fe6c-48db-a1b8-93011dffe01d req-2ed74a67-16c6-4127-8cf5-79a95ffed2b5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518024 May 20 20:32:53.200490 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e9480c-c44b-436a-b64d-86b4eb3cbe50 req-4396772a-c8a7-4883-93f7-6c2123ded82a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:53.202045 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d4e9480c-c44b-436a-b64d-86b4eb3cbe50 req-4396772a-c8a7-4883-93f7-6c2123ded82a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.1607378 May 20 20:32:53.243107 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34488f17-dbda-49c3-8226-70b974baa100 req-a3ba8b56-1f57-4436-aa98-695c96b49642 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:53.244731 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-34488f17-dbda-49c3-8226-70b974baa100 req-a3ba8b56-1f57-4436-aa98-695c96b49642 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0881565 May 20 20:32:53.253101 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d4e9480c-c44b-436a-b64d-86b4eb3cbe50 req-c4b71460-6bc8-48cb-b8da-7662904a5e69 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba6afe29-4227-4612-ab4e-56eb5a2d6275&id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0445695 May 20 20:32:53.300913 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-34488f17-dbda-49c3-8226-70b974baa100 req-5d233d83-d8fb-4d2d-9d1b-985ebb6557e6 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497875 May 20 20:32:54.485661 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f80f68-9f4d-4bfd-941f-7c830a586c7f req-753e4689-4b16-49b1-990c-8fdeab3713c5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:54.487005 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-60f80f68-9f4d-4bfd-941f-7c830a586c7f req-753e4689-4b16-49b1-990c-8fdeab3713c5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0822215 May 20 20:32:54.535282 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-60f80f68-9f4d-4bfd-941f-7c830a586c7f req-bbeec0a9-1eed-478f-a286-3a2e7a00378d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415785 May 20 20:32:55.733603 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de025bf5-ac56-4aa9-b365-6c8bee4dce7e req-64bf95f3-b0d6-4a83-a918-48e4f328601a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:55.735057 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-de025bf5-ac56-4aa9-b365-6c8bee4dce7e req-64bf95f3-b0d6-4a83-a918-48e4f328601a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0822127 May 20 20:32:55.779580 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-de025bf5-ac56-4aa9-b365-6c8bee4dce7e req-9dde02ed-3fca-44b9-a5fe-48d3262330ae tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386550 May 20 20:32:56.392295 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41872) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:56.509974 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:56.525200 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:56.529015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Usage tracker for resource:security_group_rule and tenant:c57bc974aa6d4a929e1f078d956032a6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:56.531811 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:56.537508 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:56.618711 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:56.622525 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:56.630751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fd41035c-dffd-4de6-9c7c-0ed66f4cac88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:56.670494 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c57bc974aa6d4a929e1f078d956032a6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2770438 May 20 20:32:56.672013 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=649515e8-b49f-459a-bf2c-ffbaab61965b,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:56.673210 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41878) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:56.679782 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.680213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.680606 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.680962 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.681310 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.681658 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.682073 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.682396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.682741 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.683083 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.683417 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.683772 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:32:56.687807 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:56.730866 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:56.755224 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:56.811446 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:56.815973 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-22846760-56ff-42ad-9207-a50c60562623 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:56.830612 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=649515e8-b49f-459a-bf2c-ffbaab61965b,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:56.833098 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:56.844407 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:56.856257 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/649515e8-b49f-459a-bf2c-ffbaab61965b HTTP/1.1" status: 204 len: 168 time: 0.1759493 May 20 20:32:56.981045 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f99ea4d-ba14-4739-b5b2-808e4f182376 req-4d1b29d5-4522-4715-9bd9-355389f18f77 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:56.982407 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3f99ea4d-ba14-4739-b5b2-808e4f182376 req-4d1b29d5-4522-4715-9bd9-355389f18f77 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0888112 May 20 20:32:57.028334 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3f99ea4d-ba14-4739-b5b2-808e4f182376 req-f6999c83-538a-4067-bfe1-84e6d564b70d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400136 May 20 20:32:57.133963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41888) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:57.151665 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:57.166525 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:32:57.170563 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Usage tracker for resource:security_group_rule and tenant:997a5636e4da42c296f89be33f3df96a is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:32:57.173316 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:32:57.179218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:32:57.263495 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:57.267234 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:57.274128 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-dcfd6c43-c80c-4f99-a86e-96ed9a4188a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:57.317604 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=997a5636e4da42c296f89be33f3df96a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1825814 May 20 20:32:57.318497 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e56428a-7ef1-4a44-8a22-3e7368f7efa1,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:57.320414 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 41892) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:32:57.321667 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:57.379773 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:57.404215 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:57.456748 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:57.460738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a43b3acd-e344-4808-81fd-7be6dda876ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:32:57.472490 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e56428a-7ef1-4a44-8a22-3e7368f7efa1,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:32:57.474794 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:32:57.486111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:32:57.488214 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7e56428a-7ef1-4a44-8a22-3e7368f7efa1 HTTP/1.1" status: 204 len: 168 time: 0.1661637 May 20 20:32:58.225149 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd489405-22d3-47e6-9882-356149b71709 req-39c804dd-de7d-43b0-9b8b-177e498eaca5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:58.226776 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fd489405-22d3-47e6-9882-356149b71709 req-39c804dd-de7d-43b0-9b8b-177e498eaca5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0904381 May 20 20:32:58.272669 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fd489405-22d3-47e6-9882-356149b71709 req-acefdf3a-e32b-4cbb-a160-50a9605d6145 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395653 May 20 20:32:58.799219 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:32:59.473022 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7edd2f28-8ab1-4a8e-bb72-2173dfe9d374 req-aafed211-b180-4749-9d0b-be9df627079a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:32:59.474597 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7edd2f28-8ab1-4a8e-bb72-2173dfe9d374 req-aafed211-b180-4749-9d0b-be9df627079a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0929327 May 20 20:32:59.522216 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7edd2f28-8ab1-4a8e-bb72-2173dfe9d374 req-46a1deef-65cd-478e-8ef1-d13dcefeff3a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411603 May 20 20:33:00.721443 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b44fdf-74fe-4534-9820-9c4845ed4468 req-888528af-fdb7-449b-bafe-91520e227150 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:00.721443 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-83b44fdf-74fe-4534-9820-9c4845ed4468 req-888528af-fdb7-449b-bafe-91520e227150 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0814714 May 20 20:33:00.766119 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-83b44fdf-74fe-4534-9820-9c4845ed4468 req-1b876bc4-a744-4644-b7ef-3423bcaafcad tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422866 May 20 20:33:01.956126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434f7881-68f8-426f-aff6-76e23079555a req-dd6ad6c6-8b8d-4375-b45f-4b787dbd45ba tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:01.957564 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-434f7881-68f8-426f-aff6-76e23079555a req-dd6ad6c6-8b8d-4375-b45f-4b787dbd45ba tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0835757 May 20 20:33:02.002091 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-434f7881-68f8-426f-aff6-76e23079555a req-5ca94fc6-784b-432b-bb0e-6f0afa4a2475 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385482 May 20 20:33:03.046088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d053268-81c8-4d41-b3ab-1256fb09521e req-3c1a922d-c68f-4a94-aeb4-8312bf54e8fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:03.047601 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d053268-81c8-4d41-b3ab-1256fb09521e req-3c1a922d-c68f-4a94-aeb4-8312bf54e8fa service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1098 time: 0.1726396 May 20 20:33:03.093814 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0d053268-81c8-4d41-b3ab-1256fb09521e req-43038b41-e974-48e0-8e8d-01561cf3401a service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347128 May 20 20:33:03.190772 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bbdf17-c639-4338-a7fc-c61e0b54a8ee req-4f8858f7-8632-4319-81ba-dbdf78b5ea3b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:03.192246 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-25bbdf17-c639-4338-a7fc-c61e0b54a8ee req-4f8858f7-8632-4319-81ba-dbdf78b5ea3b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0819042 May 20 20:33:03.238269 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-25bbdf17-c639-4338-a7fc-c61e0b54a8ee req-92c2a5f4-c6d6-43e5-af3e-aa04fd5f3a40 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395632 May 20 20:33:03.994946 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 41998) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:04.114052 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.128633 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:04.133124 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Usage tracker for resource:security_group_rule and tenant:4dd8bf21e04b425fbf0cb46f8ee5744a is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:04.135982 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:04.141626 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:04.227164 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.231199 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.239590 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8b2ca924-960f-4414-a8e3-4bf2111d3d77 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:04.278690 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4dd8bf21e04b425fbf0cb46f8ee5744a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2826669 May 20 20:33:04.280288 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46948b90-6d8e-44d4-8c9a-c4157f0ca3ba,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:04.281511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42006) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:04.287838 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.288192 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.288727 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.289052 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.289398 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.289741 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.290104 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.290443 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.290783 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.291118 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.291452 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.291796 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:04.298612 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-734d4b3c-d4ba-4117-a772-515e6f23f924 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:04.348555 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.421013 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.482144 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6596e90b-5724-4bf2-b7b6-ec29676fda7a req-3c02569d-907c-46b4-b380-37ffa4ab908a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:04.483728 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6596e90b-5724-4bf2-b7b6-ec29676fda7a req-3c02569d-907c-46b4-b380-37ffa4ab908a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1332412 May 20 20:33:04.520110 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.527162 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8c33ea6f-1ea9-485b-85ff-fd51d0b3a901 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:04.550480 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46948b90-6d8e-44d4-8c9a-c4157f0ca3ba,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:04.557304 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:04.560532 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.564437 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/46948b90-6d8e-44d4-8c9a-c4157f0ca3ba HTTP/1.1" status: 204 len: 168 time: 0.2816279 May 20 20:33:04.569702 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6596e90b-5724-4bf2-b7b6-ec29676fda7a req-3583c3a3-3ec9-4689-b898-6d3fa0bccf80 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688019 May 20 20:33:04.758933 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ea3313c6-7b47-4db2-8340-c6f27b7a4528 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.877511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42024) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:04.903223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:04.919739 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:04.923712 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Usage tracker for resource:security_group_rule and tenant:4ab6b2da30dc43c4a24332db9dc2eb31 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:04.926534 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:04.933075 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:05.018503 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:05.023527 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:05.032244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5f9ec9d1-2733-4b84-9b95-9b86525ef6e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:05.073241 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19ee82ae-302b-4e78-9ae5-0e5f311fbe1b,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:05.076540 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:05.078961 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a98c0621-1c5f-4a1d-a89c-d82b4b57155d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4ab6b2da30dc43c4a24332db9dc2eb31&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2004001 May 20 20:33:05.081628 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42028) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:05.144098 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:05.170992 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:05.222166 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:05.226083 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-1c67ff76-f277-46ce-b58f-7996c7171d3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:05.237614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19ee82ae-302b-4e78-9ae5-0e5f311fbe1b,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:05.239914 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:05.245834 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:05.246936 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/19ee82ae-302b-4e78-9ae5-0e5f311fbe1b HTTP/1.1" status: 204 len: 168 time: 0.1644287 May 20 20:33:05.776892 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e59e5d5-b849-490c-b11f-63f89387e273 req-e5bd90fc-d6c2-4e76-8d97-2b2e9590bfd3 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:05.778357 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4e59e5d5-b849-490c-b11f-63f89387e273 req-e5bd90fc-d6c2-4e76-8d97-2b2e9590bfd3 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0855429 May 20 20:33:05.827061 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4e59e5d5-b849-490c-b11f-63f89387e273 req-23991148-25b5-42e6-9a56-6caadfc1cb94 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429482 May 20 20:33:06.356034 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-7cffbce9-ce26-465a-9465-d85bafa81247 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:06.357586 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-7cffbce9-ce26-465a-9465-d85bafa81247 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 1098 time: 0.0768642 May 20 20:33:06.408962 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14159fb-29ae-4d79-9cb0-044bd5629d1e req-67d43538-c5fa-4d88-b72f-4fee312c32c7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:06.410444 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e14159fb-29ae-4d79-9cb0-044bd5629d1e req-67d43538-c5fa-4d88-b72f-4fee312c32c7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0881286 May 20 20:33:06.459454 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e14159fb-29ae-4d79-9cb0-044bd5629d1e req-efed4758-6d75-4e52-b40d-c234e85433b4 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425794 May 20 20:33:06.516870 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-265e69e4-a7ce-4e9b-8042-0cee5ccddeb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:06.518364 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-265e69e4-a7ce-4e9b-8042-0cee5ccddeb0 service neutron] 10.222.0.69 "GET /v2.0/networks?id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 200 len: 919 time: 0.1424415 May 20 20:33:06.595048 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-99369fef-c622-40f4-adf9-b1f1db34adc1 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 200 len: 217 time: 0.0685039 May 20 20:33:06.671072 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-057188c2-9734-4e30-b563-112ab5f8f198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:06.672848 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-057188c2-9734-4e30-b563-112ab5f8f198 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 200 len: 858 time: 0.0673332 May 20 20:33:06.727278 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-75c7fdd5-b7c4-49c5-8c6f-a0412b4b6c71 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0426807 May 20 20:33:06.940967 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-fd523895-3337-499d-b688-d4e459138826 service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2015586 May 20 20:33:07.083647 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a84a93c1-2532-4e43-89ef-e474a8e59b21 req-ed8df0f2-35d3-409c-8a05-369a7667709a service neutron] 10.222.0.69 "GET /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1309173 May 20 20:33:07.217341 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:07.490861 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2768f986-367c-41d7-b556-088611af7d54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:07.561840 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39c4866b-edd2-447e-ac5a-5df96828a126 req-74de72a8-f864-4d0a-b8cf-92d554404fae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:07.563428 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-39c4866b-edd2-447e-ac5a-5df96828a126 req-74de72a8-f864-4d0a-b8cf-92d554404fae tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1199958 May 20 20:33:07.617479 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-39c4866b-edd2-447e-ac5a-5df96828a126 req-be838e3f-f57f-48e9-a750-5d3248eae3dd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443685 May 20 20:33:07.670480 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04518cb8-dd66-4c86-ac89-14566838c0df req-f62a5a3f-6f8c-4bcf-88bb-21e3701bbb32 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:07.672047 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-04518cb8-dd66-4c86-ac89-14566838c0df req-f62a5a3f-6f8c-4bcf-88bb-21e3701bbb32 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0877934 May 20 20:33:07.721456 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-04518cb8-dd66-4c86-ac89-14566838c0df req-aac2e166-4d13-4f33-8721-a762801a190a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432971 May 20 20:33:07.948308 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42126) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:08.069534 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.084267 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:08.088487 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Usage tracker for resource:security_group_rule and tenant:7b496ab556fc4ed0b2c5347d1262d2ec is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:08.091256 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:08.096958 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:08.185701 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.190522 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.200800 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d466b3fd-ac02-4b1a-83f3-b0e39abc3bc6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:08.245537 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7b496ab556fc4ed0b2c5347d1262d2ec&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2961016 May 20 20:33:08.247140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13ce9532-689d-46ec-a943-43044de9b99b,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:08.248215 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42132) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:08.250163 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:08.277935 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.307756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.332679 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.386638 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.390367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c7a4583f-1787-4464-893c-c35014f45f1c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:08.401100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13ce9532-689d-46ec-a943-43044de9b99b,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:08.404572 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:08.407829 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.408925 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/13ce9532-689d-46ec-a943-43044de9b99b HTTP/1.1" status: 204 len: 168 time: 0.1597435 May 20 20:33:08.697976 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42142) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:08.716274 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.733166 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:08.737112 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Usage tracker for resource:security_group_rule and tenant:39d4dc71bbd8499393e2ec16f0ef4f0c is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:08.740146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:08.745887 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:08.813752 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eae8a51-bd3a-4512-9d92-412d795d1d23 req-30e38a15-1777-4184-bfed-8461b54ac5c5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:08.815251 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4eae8a51-bd3a-4512-9d92-412d795d1d23 req-30e38a15-1777-4184-bfed-8461b54ac5c5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0902469 May 20 20:33:08.862975 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4eae8a51-bd3a-4512-9d92-412d795d1d23 req-9ed9998e-7774-42d5-9bd4-af3cfab20549 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403497 May 20 20:33:08.866070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.872299 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:08.888283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-89320131-02de-468d-b896-470a3ce51d86 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:08.936388 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=39d4dc71bbd8499393e2ec16f0ef4f0c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2372184 May 20 20:33:08.939132 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42148) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:08.943502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=330294bf-11ae-4677-95f2-ce6bca8f857b,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:08.947335 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:08.971340 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e8e0d5-2b59-410f-9dfb-281f84facaad req-a761892c-956a-4370-9c73-31415c10c9c9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:08.972824 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-67e8e0d5-2b59-410f-9dfb-281f84facaad req-a761892c-956a-4370-9c73-31415c10c9c9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1411831 May 20 20:33:08.997853 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:09.018560 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-67e8e0d5-2b59-410f-9dfb-281f84facaad req-6ebf22df-6fae-4e43-ade8-fbf83eb8799f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389903 May 20 20:33:09.026354 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:09.141536 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:09.145389 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9ebe4da2-75fd-4b5a-9603-c70be73ef08e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:09.157811 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=330294bf-11ae-4677-95f2-ce6bca8f857b,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:09.160173 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:09.184318 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:09.185454 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/330294bf-11ae-4677-95f2-ce6bca8f857b HTTP/1.1" status: 204 len: 168 time: 0.2452636 May 20 20:33:09.899878 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:10.057338 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632da49c-72ea-43fa-9eee-00fc1c4e4c7f req-a400d41f-b2ea-4542-9976-cce2a2619177 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:10.059199 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-632da49c-72ea-43fa-9eee-00fc1c4e4c7f req-a400d41f-b2ea-4542-9976-cce2a2619177 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0876539 May 20 20:33:10.111791 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-632da49c-72ea-43fa-9eee-00fc1c4e4c7f req-a74e5447-5f8c-46db-b1a6-fb5ca2133a98 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457923 May 20 20:33:10.227948 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1747a7fc-14c4-4014-af3a-564c632ea3a6 req-4d0e17a5-b13c-4e5f-8315-cc7513134298 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:10.229625 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1747a7fc-14c4-4014-af3a-564c632ea3a6 req-4d0e17a5-b13c-4e5f-8315-cc7513134298 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0918446 May 20 20:33:10.277542 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1747a7fc-14c4-4014-af3a-564c632ea3a6 req-a95dc36b-c33a-454e-99fe-01e58bbb99b2 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419872 May 20 20:33:10.403124 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-e4f33d6e-60e4-4d96-bc30-6ecfaa997898 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0719488 May 20 20:33:10.579749 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-45419b5c-4de3-4bc8-83c6-a7f6d6ed853e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:10.581250 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-45419b5c-4de3-4bc8-83c6-a7f6d6ed853e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 1099 time: 0.0754416 May 20 20:33:10.754645 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-6334421d-d18b-4990-9d83-bc0264e02114 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:10.756136 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-6334421d-d18b-4990-9d83-bc0264e02114 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1382887 May 20 20:33:10.868943 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-ff6e3924-3343-4e08-9bb7-506ed36ab7fa service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 200 len: 1000 time: 0.1033914 May 20 20:33:10.950421 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-511bec0a-1fa0-436f-a54c-2eb673de34c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:10.951908 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-511bec0a-1fa0-436f-a54c-2eb673de34c0 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0597239 May 20 20:33:11.039618 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-6ee9660b-e494-4227-b300-35b14fc2de01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:11.040978 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-6ee9660b-e494-4227-b300-35b14fc2de01 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0747371 May 20 20:33:11.189647 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-e9ac98f7-a37c-4661-bbfd-fab1cf2ed9c1 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1397383 May 20 20:33:11.349491 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b087a53-f1e6-42e9-8b00-3d32872e5457 req-f1ec4a15-f632-44ee-aa75-13f5bfca2ee2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:11.351925 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1b087a53-f1e6-42e9-8b00-3d32872e5457 req-f1ec4a15-f632-44ee-aa75-13f5bfca2ee2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1293366 May 20 20:33:11.375744 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d8744363-3728-4b4f-babe-4dc4f7e72688 req-335cc03e-0e73-4544-90c0-4bc92a6aa0f3 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1659715 May 20 20:33:11.400054 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1b087a53-f1e6-42e9-8b00-3d32872e5457 req-07272782-156f-4207-9a94-a6df38e54758 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419896 May 20 20:33:11.567664 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551593fa-20ca-43a7-83a2-c51381b028fd req-6bab2edd-6e1e-4113-8613-cc27c017793d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:11.569120 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-551593fa-20ca-43a7-83a2-c51381b028fd req-6bab2edd-6e1e-4113-8613-cc27c017793d tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1731031 May 20 20:33:11.613521 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-551593fa-20ca-43a7-83a2-c51381b028fd req-f0d7280b-6901-4779-9a31-51a62a89768e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381145 May 20 20:33:12.595070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a867824-1db9-4e46-84a0-f6b2265594ba req-dd4f76e8-b0f8-4226-ae07-546cf3c85ad7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:12.596565 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a867824-1db9-4e46-84a0-f6b2265594ba req-dd4f76e8-b0f8-4226-ae07-546cf3c85ad7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0861750 May 20 20:33:12.642800 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4a867824-1db9-4e46-84a0-f6b2265594ba req-ebd0825b-2928-4364-ae15-d1b73b0f4508 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391471 May 20 20:33:13.835919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5fe7c72-9f53-4d31-a91d-3815e78759bd req-f7d4fef7-9f10-45a4-9fa0-396d21714f4d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:13.837536 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f5fe7c72-9f53-4d31-a91d-3815e78759bd req-f7d4fef7-9f10-45a4-9fa0-396d21714f4d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0855987 May 20 20:33:13.886201 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f5fe7c72-9f53-4d31-a91d-3815e78759bd req-1bd87133-58ed-453d-91f7-5efb074c648a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429645 May 20 20:33:15.022290 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:15.071293 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a4bc7e-2f5a-4d2e-8ce4-96dea8a60995 req-217f6bfa-6864-478f-9766-fdca8b4000d5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:15.072978 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-53a4bc7e-2f5a-4d2e-8ce4-96dea8a60995 req-217f6bfa-6864-478f-9766-fdca8b4000d5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0807564 May 20 20:33:15.118506 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-53a4bc7e-2f5a-4d2e-8ce4-96dea8a60995 req-5ba53fa3-b3c6-4760-98cf-9e514f16b5d3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395017 May 20 20:33:16.309629 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757d9b23-abd7-46c8-b7d2-0c1a68ca2ace req-6e2a87d3-0aa7-45ae-bb65-0f4ba28cb437 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:16.311005 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-757d9b23-abd7-46c8-b7d2-0c1a68ca2ace req-6e2a87d3-0aa7-45ae-bb65-0f4ba28cb437 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0790679 May 20 20:33:16.360253 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-757d9b23-abd7-46c8-b7d2-0c1a68ca2ace req-9b4e924c-6733-4cff-a913-d5b85fd076e5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434608 May 20 20:33:17.246700 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd6d56a-ecd0-4aeb-bf93-45bcaa6f3570 req-450531f6-7045-4c52-8737-9148716289a5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:17.247837 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5cd6d56a-ecd0-4aeb-bf93-45bcaa6f3570 req-450531f6-7045-4c52-8737-9148716289a5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0813034 May 20 20:33:17.293579 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5cd6d56a-ecd0-4aeb-bf93-45bcaa6f3570 req-18839815-f077-4fba-8a0b-087618454dd1 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400822 May 20 20:33:17.565841 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f61a9b-3b48-4f9d-8d82-1ec3aa7c3431 req-8fffbc11-5fd4-4f4b-a161-d854f3ca8dbd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:17.567280 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-41f61a9b-3b48-4f9d-8d82-1ec3aa7c3431 req-8fffbc11-5fd4-4f4b-a161-d854f3ca8dbd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0881238 May 20 20:33:17.612894 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-41f61a9b-3b48-4f9d-8d82-1ec3aa7c3431 req-45be435d-b68f-47d4-84ed-41c875563cc4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398052 May 20 20:33:18.481734 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37efbd1b-350c-4695-8ae1-8f6541d8aa68 req-9d956d85-9ebd-47f0-89b7-4e5dfd483c43 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:18.483179 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-37efbd1b-350c-4695-8ae1-8f6541d8aa68 req-9d956d85-9ebd-47f0-89b7-4e5dfd483c43 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0859654 May 20 20:33:18.528575 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-37efbd1b-350c-4695-8ae1-8f6541d8aa68 req-ad5f5e28-5ca7-47c6-b141-71dcbaddaddc tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396481 May 20 20:33:18.805326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c4dad1-1506-4ab2-9bc8-e26302776be2 req-cbfaee8b-8900-437d-b19c-6bebdaf23630 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:18.807381 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c5c4dad1-1506-4ab2-9bc8-e26302776be2 req-cbfaee8b-8900-437d-b19c-6bebdaf23630 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0850906 May 20 20:33:18.857629 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c5c4dad1-1506-4ab2-9bc8-e26302776be2 req-a84a5f48-0925-4f86-84d0-75047c57ad54 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439522 May 20 20:33:19.713338 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ab6e6c-f101-4c9d-9a5f-a7495f862c1c req-e88a9048-0903-45ff-8faf-84c66bc31be9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:19.714821 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-12ab6e6c-f101-4c9d-9a5f-a7495f862c1c req-e88a9048-0903-45ff-8faf-84c66bc31be9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0790703 May 20 20:33:19.759463 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-12ab6e6c-f101-4c9d-9a5f-a7495f862c1c req-1fafe18e-5bf2-4c0a-9f41-25cd3755b6fb tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389931 May 20 20:33:20.050099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b28178-a340-4128-9f1d-658064a3cb69 req-f909806d-e698-4750-8f3b-a616ec567988 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:20.051564 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-22b28178-a340-4128-9f1d-658064a3cb69 req-f909806d-e698-4750-8f3b-a616ec567988 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0842054 May 20 20:33:20.099820 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-22b28178-a340-4128-9f1d-658064a3cb69 req-9bf22d13-0098-4e01-8d1d-a2c6f976f187 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407190 May 20 20:33:20.944136 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca88455-04dc-4f9b-ac4b-56ac78c9e1c1 req-edf2aa25-dc38-4d67-9806-92869ad143c0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:20.945578 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eca88455-04dc-4f9b-ac4b-56ac78c9e1c1 req-edf2aa25-dc38-4d67-9806-92869ad143c0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0829470 May 20 20:33:20.990610 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-eca88455-04dc-4f9b-ac4b-56ac78c9e1c1 req-081b960a-8772-4c73-9ad9-ded3c77ee053 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379896 May 20 20:33:21.293387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37566dec-fd1d-48a4-96f6-31e625ab413a req-4a409d54-9257-41e8-a8fb-712018b6650f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:21.294982 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37566dec-fd1d-48a4-96f6-31e625ab413a req-4a409d54-9257-41e8-a8fb-712018b6650f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0872467 May 20 20:33:21.341413 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37566dec-fd1d-48a4-96f6-31e625ab413a req-b5239480-fd7e-44f2-aa08-6ce17c1ac5c6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405247 May 20 20:33:21.420029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42328) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:21.542658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:21.557536 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:21.561296 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Usage tracker for resource:security_group_rule and tenant:c7995ae56805486986c980da979b9434 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:21.564052 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:21.569637 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:21.652681 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:21.656442 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:21.664431 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c88139f9-230a-4c63-928b-3f216e10ebf9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:21.706056 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c7995ae56805486986c980da979b9434&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2849784 May 20 20:33:21.707042 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=736b5397-91a2-47e5-aa3c-5fa27978b35f,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:21.708879 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42334) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:21.710185 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:21.768436 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:21.795327 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:21.845408 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:21.849161 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2288d7ab-61d3-402a-a35e-299241f31c6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:21.862712 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=736b5397-91a2-47e5-aa3c-5fa27978b35f,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:21.865241 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:21.872969 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:21.874086 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/736b5397-91a2-47e5-aa3c-5fa27978b35f HTTP/1.1" status: 204 len: 168 time: 0.1641657 May 20 20:33:22.020042 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-26b4d010-15f9-46b4-86f4-3151bad93d69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:22.021457 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-26b4d010-15f9-46b4-86f4-3151bad93d69 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0852346 May 20 20:33:22.176894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42344) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:22.186013 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb6f98b-e53f-42fc-96b5-17b3d6a41df7 req-ddd2acf0-2466-41bc-8809-932746e8d832 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:22.187468 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dcb6f98b-e53f-42fc-96b5-17b3d6a41df7 req-ddd2acf0-2466-41bc-8809-932746e8d832 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 945 time: 0.0864742 May 20 20:33:22.196530 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Deleting port 158c47cc-29b6-4cf6-943a-0acad5faa050 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:33:22.197071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.215124 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.233828 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dcb6f98b-e53f-42fc-96b5-17b3d6a41df7 req-d331e961-a2b2-4725-abd1-e5d54abbfd2e tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403988 May 20 20:33:22.251067 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:22.307797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Usage tracker for resource:security_group_rule and tenant:bf14e8fd8cfc445ab029e9d9853da315 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:22.312341 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:22.326957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:22.380743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] For port 158c47cc-29b6-4cf6-943a-0acad5faa050, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=158c47cc-29b6-4cf6-943a-0acad5faa050,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:22.381097 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.513943 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Calling delete_port for 158c47cc-29b6-4cf6-943a-0acad5faa050 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:33:22.655065 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.668118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.674792 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-71143b5e-5164-4079-be54-6080b401fb4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:22.688431 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153dcd43-81eb-4453-b984-d3a0ae9c9771 req-3c72ef29-7685-4483-8672-e39fa7a9eac2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:22.689870 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-153dcd43-81eb-4453-b984-d3a0ae9c9771 req-3c72ef29-7685-4483-8672-e39fa7a9eac2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1861444 May 20 20:33:22.748211 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bf14e8fd8cfc445ab029e9d9853da315&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5701404 May 20 20:33:22.750830 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42350) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:22.785711 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcb34e3b-4335-4506-b1e1-16c09d31df09,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:22.788844 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-83c10131-e31b-4ce7-82a2-3fa8266a22cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:22.811705 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.826551 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-153dcd43-81eb-4453-b984-d3a0ae9c9771 req-dc9e7bbc-da70-4dd6-a072-16ae936a1f2c tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1271868 May 20 20:33:22.839749 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.840872 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.847362 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-366fb679-9d19-4438-8834-20476542acd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:22.872355 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['44eaea5c-405a-4120-95d6-2f5a1da3ac29', '158c47cc-29b6-4cf6-943a-0acad5faa050'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:33:22.891190 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Pushing event deleted for resources: {'Port': ['ID=158c47cc-29b6-4cf6-943a-0acad5faa050,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:22.894428 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:22.909289 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.914843 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0aac91a1-753e-4d91-8d41-825a1be76583 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:22.929506 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcb34e3b-4335-4506-b1e1-16c09d31df09,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:22.932724 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:22.940123 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:22.943883 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dcb34e3b-4335-4506-b1e1-16c09d31df09 HTTP/1.1" status: 204 len: 168 time: 0.1898897 May 20 20:33:23.057548 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] No DVR routers for this DVR port 158c47cc-29b6-4cf6-943a-0acad5faa050 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:33:23.060162 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:23.062804 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a719272-e929-4463-9b07-480500fcb622', 'name': 'network-vif-deleted', 'tag': '158c47cc-29b6-4cf6-943a-0acad5faa050'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:33:23.086331 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-430b7552-a2ca-41b2-9997-23f8decf3219 req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "DELETE /v2.0/ports/158c47cc-29b6-4cf6-943a-0acad5faa050 HTTP/1.1" status: 204 len: 173 time: 1.0530803 May 20 20:33:23.333901 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a719272-e929-4463-9b07-480500fcb622', 'name': 'network-vif-deleted', 'tag': '158c47cc-29b6-4cf6-943a-0acad5faa050', 'status': 'completed', 'code': 200} May 20 20:33:23.424857 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-461dcb8d-b9dd-4955-bff8-eb04ce24db7a req-2a0c9975-524a-46f1-ab2e-8b75d093dce7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Synchronizing usage tracker for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:33:23.440966 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-461dcb8d-b9dd-4955-bff8-eb04ce24db7a req-2a0c9975-524a-46f1-ab2e-8b75d093dce7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Unset dirty status for tenant:d7d330ce02bc4a5b849c6cd53ef67558 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:33:23.448341 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-461dcb8d-b9dd-4955-bff8-eb04ce24db7a req-2a0c9975-524a-46f1-ab2e-8b75d093dce7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a719272-e929-4463-9b07-480500fcb622 HTTP/1.1" status: 200 len: 210 time: 0.0657575 May 20 20:33:24.025706 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe0fab8f-9ab9-430f-8cec-e1ec4f69b4a0 req-044ee904-21e3-46da-838a-33df49ff24f9 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:24.027890 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fe0fab8f-9ab9-430f-8cec-e1ec4f69b4a0 req-044ee904-21e3-46da-838a-33df49ff24f9 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0862434 May 20 20:33:24.083088 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fe0fab8f-9ab9-430f-8cec-e1ec4f69b4a0 req-90c66d2d-94de-4b71-9983-fbc64688e93f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482538 May 20 20:33:24.903249 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d701f9f-9b45-408d-8fc0-0c3be83dbc5e req-ab6dc376-9c20-4ab4-af62-ec85bfcdf923 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:24.904730 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d701f9f-9b45-408d-8fc0-0c3be83dbc5e req-ab6dc376-9c20-4ab4-af62-ec85bfcdf923 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0813918 May 20 20:33:24.951501 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d701f9f-9b45-408d-8fc0-0c3be83dbc5e req-b319f009-149c-4eb1-8158-06d804896445 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411503 May 20 20:33:25.287307 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315cf0e5-3b7a-4b81-a96e-1d16cc307014 req-1cd0551a-91de-488f-8ded-6d510a5a54af tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:25.288831 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-315cf0e5-3b7a-4b81-a96e-1d16cc307014 req-1cd0551a-91de-488f-8ded-6d510a5a54af tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0881271 May 20 20:33:25.335326 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-315cf0e5-3b7a-4b81-a96e-1d16cc307014 req-b3968c7a-fbed-4a50-950b-6ffb066bbf97 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403256 May 20 20:33:26.082535 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 158c47cc-29b6-4cf6-943a-0acad5faa050 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:33:26.117959 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 158c47cc-29b6-4cf6-943a-0acad5faa050 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:33:26.118884 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 158c47cc-29b6-4cf6-943a-0acad5faa050 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:33:26.141205 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e707399d-1bec-485b-8cbb-46020fc71c53 req-cb84a463-26b0-4725-9c57-729bf8a866d0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:26.142809 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e707399d-1bec-485b-8cbb-46020fc71c53 req-cb84a463-26b0-4725-9c57-729bf8a866d0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0834205 May 20 20:33:26.189782 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e707399d-1bec-485b-8cbb-46020fc71c53 req-8fc4628e-850a-4802-a9cd-7a2e9af62c4b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410690 May 20 20:33:26.525874 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ddecee3-7910-412a-97ec-5594b301e03e req-fcba71d3-f987-4668-9129-bd078e8bb3f6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:26.527345 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5ddecee3-7910-412a-97ec-5594b301e03e req-fcba71d3-f987-4668-9129-bd078e8bb3f6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0806561 May 20 20:33:26.576378 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5ddecee3-7910-412a-97ec-5594b301e03e req-c9f5b5cc-0f2e-4e60-8f1a-e81d44e472d0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432537 May 20 20:33:27.380786 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f3264c9-2db6-45b2-bdc2-b289d54c2739 req-2c17133b-2e8d-4815-a5d3-32681b96c6a9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:27.382223 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5f3264c9-2db6-45b2-bdc2-b289d54c2739 req-2c17133b-2e8d-4815-a5d3-32681b96c6a9 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0839660 May 20 20:33:27.427544 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5f3264c9-2db6-45b2-bdc2-b289d54c2739 req-4b2d014c-bc4d-4387-ae19-3e7cfe06944c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392976 May 20 20:33:27.767079 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8545bd6a-9d7b-4f73-924c-d25f35c821bc req-414c0563-1819-4626-9b37-03bb7b0aebf1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:27.768570 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8545bd6a-9d7b-4f73-924c-d25f35c821bc req-414c0563-1819-4626-9b37-03bb7b0aebf1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0828903 May 20 20:33:27.815848 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8545bd6a-9d7b-4f73-924c-d25f35c821bc req-f8c6a977-015f-431e-8541-8fe852c0b0a7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403581 May 20 20:33:28.594900 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b77bde-b33b-4b0e-bfed-d12e5970dde2 req-8db7697c-e5e5-4c61-bb60-b4cce0afd560 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:28.596383 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f4b77bde-b33b-4b0e-bfed-d12e5970dde2 req-8db7697c-e5e5-4c61-bb60-b4cce0afd560 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.0861306 May 20 20:33:28.622500 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98718606-bc78-4fd6-abac-d881e1a330ff req-f2508bd2-f2e3-46d6-937a-02ed00e975e5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:28.624004 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-98718606-bc78-4fd6-abac-d881e1a330ff req-f2508bd2-f2e3-46d6-937a-02ed00e975e5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0836976 May 20 20:33:28.644122 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f4b77bde-b33b-4b0e-bfed-d12e5970dde2 req-ef197233-50fa-434b-a508-39b8084405aa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418313 May 20 20:33:28.674772 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-98718606-bc78-4fd6-abac-d881e1a330ff req-960eb5e8-afd1-42ff-9f93-9339b6a1c223 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445335 May 20 20:33:29.002028 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550d246b-043c-49f8-8a03-2e161f5aebc6 req-f916d7e8-3dd7-4571-86ba-e2a60a25a94e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:29.003471 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-550d246b-043c-49f8-8a03-2e161f5aebc6 req-f916d7e8-3dd7-4571-86ba-e2a60a25a94e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0785804 May 20 20:33:29.048627 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-550d246b-043c-49f8-8a03-2e161f5aebc6 req-59c705fc-96d1-4802-b039-596aa673caec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391407 May 20 20:33:29.462165 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2fd6249-3d94-4dac-9666-46a7a266a5e2 req-32c8012f-026a-4a3c-a038-ab3792bdb885 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:29.463733 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e2fd6249-3d94-4dac-9666-46a7a266a5e2 req-32c8012f-026a-4a3c-a038-ab3792bdb885 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.1556273 May 20 20:33:29.480760 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-f2e828b7-ef64-456d-8766-6182bc525187 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:29.482229 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-f2e828b7-ef64-456d-8766-6182bc525187 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1099 time: 0.0714066 May 20 20:33:29.511962 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e2fd6249-3d94-4dac-9666-46a7a266a5e2 req-14dcef17-06a9-4063-aa39-c6b1c851f107 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423725 May 20 20:33:29.622796 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-3545f31a-0782-4402-a97b-5177ad83ea7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:29.624242 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-3545f31a-0782-4402-a97b-5177ad83ea7e service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.1302786 May 20 20:33:29.744501 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-912a8001-6985-4b93-84ba-5414e1b37d4d service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 1001 time: 0.1004529 May 20 20:33:29.868693 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f38c7d9-346e-45b8-9937-c5275fa6667a req-77f4b016-6099-4d56-874d-f8016ecc9bf5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:29.870268 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6f38c7d9-346e-45b8-9937-c5275fa6667a req-77f4b016-6099-4d56-874d-f8016ecc9bf5 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0842931 May 20 20:33:29.871478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-7520df1d-0a42-4bfe-9803-523426d2623e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:29.872909 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-7520df1d-0a42-4bfe-9803-523426d2623e service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.0807118 May 20 20:33:29.892008 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9462a1e-68ad-410a-a915-b6a543fa1967 req-ee573ecd-c171-4dae-bc66-18df27b9bb89 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:29.893453 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f9462a1e-68ad-410a-a915-b6a543fa1967 req-ee573ecd-c171-4dae-bc66-18df27b9bb89 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.1368976 May 20 20:33:29.918228 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6f38c7d9-346e-45b8-9937-c5275fa6667a req-abfab852-4d30-4d57-91b7-b7e49d703958 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420082 May 20 20:33:29.987901 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f9462a1e-68ad-410a-a915-b6a543fa1967 req-d0f90642-62ea-49da-8f54-003eaa038b64 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557308 May 20 20:33:30.001300 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-bef6cc57-3ce6-4e5f-b524-8ccca3e814d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:30.002734 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-bef6cc57-3ce6-4e5f-b524-8ccca3e814d2 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1060715 May 20 20:33:30.156619 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-8f7f0121-abfe-44a9-a1d2-5a9e59be53af service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1268854 May 20 20:33:30.298065 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e51642e5-84eb-4269-9b63-c6289332fc94 req-f84d51dc-1e03-4736-a2c2-0f158c2fcceb service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259429 May 20 20:33:30.699292 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc2942ea-a1e3-4dc3-82e2-17cae5c795a4 req-6dbc372a-f669-441a-8b96-bfb943061005 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:30.700860 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dc2942ea-a1e3-4dc3-82e2-17cae5c795a4 req-6dbc372a-f669-441a-8b96-bfb943061005 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0808065 May 20 20:33:30.747233 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dc2942ea-a1e3-4dc3-82e2-17cae5c795a4 req-125f747b-0911-4c79-8dba-6b1e5625e698 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406947 May 20 20:33:31.112501 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1878c647-9d6a-46c6-b3c1-8645ea15fcc5 req-20a9e0fe-f8f6-49bd-b488-19d25fcafdd0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:31.114111 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1878c647-9d6a-46c6-b3c1-8645ea15fcc5 req-20a9e0fe-f8f6-49bd-b488-19d25fcafdd0 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0864620 May 20 20:33:31.159422 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1878c647-9d6a-46c6-b3c1-8645ea15fcc5 req-84e3cad9-f3f0-41d1-b171-d434a9a189b7 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388963 May 20 20:33:31.190626 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a7ff9e-ce7d-44af-8a9e-3f5572713f5a req-b45381dc-70a2-4301-9722-1d5322c1b314 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:31.192093 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-58a7ff9e-ce7d-44af-8a9e-3f5572713f5a req-b45381dc-70a2-4301-9722-1d5322c1b314 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.0840166 May 20 20:33:31.239959 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-58a7ff9e-ce7d-44af-8a9e-3f5572713f5a req-83675d90-2dcf-4b7f-a7f0-c17bfc9bfb53 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412195 May 20 20:33:31.932924 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ab0b2c-7d6d-4edb-9be7-18b263734803 req-ab381f7f-b077-448a-b593-dbe40dc11b39 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:31.934373 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b2ab0b2c-7d6d-4edb-9be7-18b263734803 req-ab381f7f-b077-448a-b593-dbe40dc11b39 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0799477 May 20 20:33:31.981064 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b2ab0b2c-7d6d-4edb-9be7-18b263734803 req-51829999-04f2-41dd-8973-d82f1a4a6248 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410039 May 20 20:33:32.353028 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-defcaa07-69f5-459e-9cef-670fe0b44dff req-2834b028-473b-462a-ae07-590f8f1f729c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:32.354593 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-defcaa07-69f5-459e-9cef-670fe0b44dff req-2834b028-473b-462a-ae07-590f8f1f729c tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0877628 May 20 20:33:32.401261 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-defcaa07-69f5-459e-9cef-670fe0b44dff req-8b263856-da2e-4890-93bf-0daa2588237a tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409234 May 20 20:33:32.569214 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22279c60-a01a-4427-882c-4f78f2b0a1ec req-d89948e4-8cfa-4aba-a300-712b5ad134ca tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:32.571205 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-22279c60-a01a-4427-882c-4f78f2b0a1ec req-d89948e4-8cfa-4aba-a300-712b5ad134ca tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.2148612 May 20 20:33:32.618320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-1a7fd556-f580-4891-bc35-09ee388450d9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:32.619705 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-1a7fd556-f580-4891-bc35-09ee388450d9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 946 time: 0.2084601 May 20 20:33:32.629326 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-22279c60-a01a-4427-882c-4f78f2b0a1ec req-d45556f7-eaff-4d27-8707-53af71ba7973 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=3dbb244a-aebf-4ce5-9550-40907a2dbee9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0518458 May 20 20:33:32.767989 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Deleting port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:33:32.768337 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:32.899697 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] For port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:32.899988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:33.188947 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:33.189338 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:33.189644 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Floating IP 1101f725-c21b-4379-8652-4a224ba3c1fd disassociated. External IP: 172.27.3.32, port: 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6. May 20 20:33:33.189980 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Calling delete_port for 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:33:33.304246 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:33.310287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6912e1ad-a0d9-4ff4-9280-f641aa9fd3af tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:33.358282 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event deleted for resources: {'Port': ['ID=80d1054a-94cc-4a2a-8c3e-af2e4e501ee6,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:33.361690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:33.552008 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Router cdb694ee-b9bf-4ffe-895b-e76ca953be5d has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:33:33.594678 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a3fecb-1f08-42e6-8d99-842857174e89 req-0e899006-d2ff-4a07-8680-9f4eea4c4f70 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:33.596156 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-26a3fecb-1f08-42e6-8d99-842857174e89 req-0e899006-d2ff-4a07-8680-9f4eea4c4f70 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0834634 May 20 20:33:33.642661 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-26a3fecb-1f08-42e6-8d99-842857174e89 req-b9abe798-41a0-4ba5-abc2-c53423970254 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405860 May 20 20:33:33.745308 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:33:33.754627 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] Sync routers for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:33:33.765053 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:33:33.765744 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:33:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:33.855712 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-474fbd66-6973-428c-af58-cad0548f2713 req-5244575c-30ba-43ed-9d83-9cd87b6aead8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2cffaca-78d5-4ea8-adec-c8a7595bc1df HTTP/1.1" status: 200 len: 210 time: 0.0842841 May 20 20:33:33.861065 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] No DVR routers for this DVR port 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:33:33.863582 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:33.876931 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-deleted', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:33:33.896413 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-de5e1cba-f650-48bf-a900-52fc2404f579 req-d1a15b67-1e22-4b16-a9b8-16fcda73ca73 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "DELETE /v2.0/ports/80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 HTTP/1.1" status: 204 len: 173 time: 1.2644675 May 20 20:33:33.931613 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2cffaca-78d5-4ea8-adec-c8a7595bc1df', 'name': 'network-vif-deleted', 'tag': '80d1054a-94cc-4a2a-8c3e-af2e4e501ee6', 'status': 'completed', 'code': 200} May 20 20:33:34.005189 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:33:34.331923 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:34.335755 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] Checking router: cdb694ee-b9bf-4ffe-895b-e76ca953be5d for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:33:34.344834 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:33:34.345437 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:33:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:34.520600 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:33:34.777308 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3fc41bcf-2a41-467d-881f-dbdd168b5865 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:34.849899 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86eee4c2-f8ed-4d32-8c75-cddfd47136ba req-1bb96118-d8e8-46fb-a6bc-eaa45287ed52 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:34.850501 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:34.851498 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86eee4c2-f8ed-4d32-8c75-cddfd47136ba req-1bb96118-d8e8-46fb-a6bc-eaa45287ed52 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0900862 May 20 20:33:34.854160 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8362ff18-23b7-4024-bf50-cf4823d379ee None None] The sync data for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi is: [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:33:34.913240 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-86eee4c2-f8ed-4d32-8c75-cddfd47136ba req-88f62059-3e5c-41f0-98c9-693803ad101f tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527494 May 20 20:33:35.001894 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42540) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:35.083747 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.113200 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.151656 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ef436d8-16a1-447a-8a3f-c42461a00e44 None None] New status for floating IP 1101f725-c21b-4379-8652-4a224ba3c1fd: DOWN {{(pid=91647) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:33:35.169513 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.173456 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e37da3d4-9f38-4d4a-bab4-1957af274031 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:35.189251 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dbb244a-aebf-4ce5-9550-40907a2dbee9,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:35.191998 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:35.212220 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.216110 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "DELETE /v2.0/security-groups/3dbb244a-aebf-4ce5-9550-40907a2dbee9 HTTP/1.1" status: 204 len: 168 time: 0.2131498 May 20 20:33:35.216352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42544) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:35.235275 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.api.v2.resource [None req-8b479241-5fc6-4162-96af-8dd4ffa16eaa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] show failed (client error): The resource could not be found. May 20 20:33:35.236469 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-8b479241-5fc6-4162-96af-8dd4ffa16eaa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups/3dbb244a-aebf-4ce5-9550-40907a2dbee9 HTTP/1.1" status: 404 len: 347 time: 0.0188537 May 20 20:33:35.239328 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42548) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:35.600886 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Deleting port a01ef44d-8f06-4963-aeb4-4bed7b67e7c2 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:33:35.601220 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.721635 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.721961 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.798409 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:33:35.843995 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Calling delete_port for a01ef44d-8f06-4963-aeb4-4bed7b67e7c2 owned by network:floatingip {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:33:35.954115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:35.958680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:36.007064 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event deleted for resources: {'Port': ['ID=a01ef44d-8f06-4963-aeb4-4bed7b67e7c2,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:36.038385 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:36.106045 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.108539 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e95eac-29ac-4df5-a3cf-e2d0039e3969 req-b87fec8a-dc13-4da4-bef0-706efd057104 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:36.110133 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-49e95eac-29ac-4df5-a3cf-e2d0039e3969 req-b87fec8a-dc13-4da4-bef0-706efd057104 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0882227 May 20 20:33:36.114692 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:33:36.121109 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.125294 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "DELETE /v2.0/floatingips/1101f725-c21b-4379-8652-4a224ba3c1fd HTTP/1.1" status: 204 len: 168 time: 0.8819253 May 20 20:33:36.157628 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:33:36.157978 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 80d1054a-94cc-4a2a-8c3e-af2e4e501ee6 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:33:36.175266 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-49e95eac-29ac-4df5-a3cf-e2d0039e3969 req-30c26630-e80a-445f-b749-18336afddd32 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574567 May 20 20:33:36.405346 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42558) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:36.410490 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1074634595', 'description': 'tempest-description--690227039'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:33:36.416387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:36.420690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:36.423481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:36.429886 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:36.444644 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.469331 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:36.475465 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group_rule and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:36.480976 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:36.487579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:36.560128 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.563833 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.568767 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:36.610544 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'SecurityGroup': ['ID=10c3893a-57c7-4733-9ee1-08e1c9a8bd72,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:36.613561 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.614408 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.2080784 May 20 20:33:36.615259 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:36.617207 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42564) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:36.626478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'security_group_rule': {'security_group_id': '10c3893a-57c7-4733-9ee1-08e1c9a8bd72', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:33:36.632659 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:36.637619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group_rule and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:36.642396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:36.648547 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:36.665894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.726542 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.730481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.732693 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:36.754766 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3867b030-2f01-4212-bc6b-2e89f380b389,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:36.757159 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:36.766087 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.767328 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e39e2cef-c619-4e03-93ef-83a171dc8b12 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1452498 May 20 20:33:36.770081 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42568) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:36.776366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'security_group_rule': {'security_group_id': '10c3893a-57c7-4733-9ee1-08e1c9a8bd72', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:33:36.782488 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:36.786905 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:security_group_rule and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:36.790975 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:36.802200 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:36.816663 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.853889 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-ba38967b-87b9-45b6-b3e1-acf4a6f9ba32 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:36.855321 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-ba38967b-87b9-45b6-b3e1-acf4a6f9ba32 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.0868890 May 20 20:33:36.880293 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.884693 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.886896 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7f02922c-762a-49c8-afe1-8ac8c52d44af tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:36.908613 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=97a93ce3-c020-4b8c-888a-6c68aaa386db,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:36.914844 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:36.919964 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:36.921153 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-199ae389-5b88-4d03-8b5b-09da024358b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1496575 May 20 20:33:36.924202 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42572) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:36.929667 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:33:36.936063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:36.939940 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Usage tracker for resource:floatingip and tenant:d5d038c87b86437990c22a9e55b308b6 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:36.942837 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:36.949221 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:36.960955 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.004604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Deleting port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:33:37.005171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.096845 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.137344 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] For port 44eaea5c-405a-4120-95d6-2f5a1da3ac29, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44eaea5c-405a-4120-95d6-2f5a1da3ac29,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:37.137689 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.219831 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.265496 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Calling delete_port for 44eaea5c-405a-4120-95d6-2f5a1da3ac29 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:33:37.265712 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Allocated IP 172.27.3.48 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/37b4b970-471b-495e-a080-a26eb390c2b6) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:33:37.384448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.390150 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-71bacf6e-7a91-4dc8-b611-fa1569a62d82 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:37.405614 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['44eaea5c-405a-4120-95d6-2f5a1da3ac29'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:33:37.448810 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Pushing event deleted for resources: {'Port': ['ID=44eaea5c-405a-4120-95d6-2f5a1da3ac29,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:37.451935 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:37.493212 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd8fcb1-5131-4bea-985d-a4463e084c05 req-738f0e63-11ac-46af-87ac-f346d709e827 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:37.495093 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5cd8fcb1-5131-4bea-985d-a4463e084c05 req-738f0e63-11ac-46af-87ac-f346d709e827 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/ports?device_id=146c570a-0416-4de3-a927-1c1daa195300 HTTP/1.1" status: 200 len: 945 time: 0.1979978 May 20 20:33:37.498624 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-27ffc632-a6b6-4e42-ae32-62c928a402e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.504383 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.525331 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] No DVR routers for this DVR port 44eaea5c-405a-4120-95d6-2f5a1da3ac29 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:33:37.527607 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.530685 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '146c570a-0416-4de3-a927-1c1daa195300', 'name': 'network-vif-deleted', 'tag': '44eaea5c-405a-4120-95d6-2f5a1da3ac29'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:33:37.546907 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2a672d4e-0fd1-463d-985a-5d436db5c4ed req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.69 "DELETE /v2.0/ports/44eaea5c-405a-4120-95d6-2f5a1da3ac29 HTTP/1.1" status: 204 len: 173 time: 0.6818147 May 20 20:33:37.561638 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5cd8fcb1-5131-4bea-985d-a4463e084c05 req-c1632123-b5fa-45ea-8438-0e0099e2776b tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] 10.222.0.82 "GET /v2.0/security-groups?id=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538154 May 20 20:33:37.590478 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '146c570a-0416-4de3-a927-1c1daa195300', 'name': 'network-vif-deleted', 'tag': '44eaea5c-405a-4120-95d6-2f5a1da3ac29', 'status': 'completed', 'code': 200} May 20 20:33:37.590970 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.596053 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4404944e-d42f-4760-a0f9-95d4fc9a8f2e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:37.657580 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:33:37.660504 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:33:37.664799 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:33:37.699022 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'Port': ['ID=37b4b970-471b-495e-a080-a26eb390c2b6,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:37.703007 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:37.797068 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:37.866955 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:38.153607 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:38.158108 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3178412'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:38.161750 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0dfb5a9f-481c-43c7-8e03-ae3b3e9af270 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:38.280218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'Port': ['ID=37b4b970-471b-495e-a080-a26eb390c2b6,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:38.284977 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:38.292130 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:38.295384 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:38.317957 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:38.319382 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.3942695 May 20 20:33:38.497904 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-7af52bb2-b357-44e3-852e-20dc8eb274d8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:33:38.513447 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-7af52bb2-b357-44e3-852e-20dc8eb274d8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:33:38.514731 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-7af52bb2-b357-44e3-852e-20dc8eb274d8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1074634595&fields=id&tenant_id=d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 267 time: 0.0571270 May 20 20:33:38.661661 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42598) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:38.664419 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-fbcbe4f2-60bf-4551-847a-51ca25fa3573 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:38.665860 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-fbcbe4f2-60bf-4551-847a-51ca25fa3573 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 817 time: 0.1445918 May 20 20:33:38.681638 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-4d106392-7ee1-40ba-9daa-6dbd448c5b84 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/quotas/d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 375 time: 0.0100458 May 20 20:33:38.784189 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-e81379e7-e45d-4967-b7a3-253eca676065 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0970798 May 20 20:33:38.975460 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-ff8b4df2-e779-41ae-a012-02611dcbbdc6 service neutron] 10.222.0.82 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1786649 May 20 20:33:39.107964 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9361da2e-3a0e-49c1-bb29-b15c4c2c5ddf service neutron] 10.222.0.82 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259451 May 20 20:33:39.458455 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:39.866035 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Deleting port c0fdfd3a-cf39-40ab-842f-b7613dba71a5 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:33:39.866721 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:39.904963 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:39.992772 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] For port c0fdfd3a-cf39-40ab-842f-b7613dba71a5, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,segment=NetworkSegment(a7f5843a-4d24-4474-8e1a-3683e9d0f8a4),segment_id=a7f5843a-4d24-4474-8e1a-3683e9d0f8a4)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:39.993190 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:40.118883 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Calling delete_port for c0fdfd3a-cf39-40ab-842f-b7613dba71a5 owned by network:router_interface {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:33:40.131695 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44eaea5c-405a-4120-95d6-2f5a1da3ac29 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:33:40.168353 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 44eaea5c-405a-4120-95d6-2f5a1da3ac29 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:33:40.168694 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44eaea5c-405a-4120-95d6-2f5a1da3ac29 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:33:40.418451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7ebfdd73-9e0d-4971-a5d7-540fad254337 req-9a250e8e-e6d3-49c3-ba95-3d6d29551f87 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:33:40.456089 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7ebfdd73-9e0d-4971-a5d7-540fad254337 req-9a250e8e-e6d3-49c3-ba95-3d6d29551f87 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:33:40.457356 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7ebfdd73-9e0d-4971-a5d7-540fad254337 req-9a250e8e-e6d3-49c3-ba95-3d6d29551f87 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 210 time: 0.0972655 May 20 20:33:40.554106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:40.558484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-48539ebb-aa33-45d9-84a9-2e1c102380dd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:40.602690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Pushing event deleted for resources: {'Port': ['ID=c0fdfd3a-cf39-40ab-842f-b7613dba71a5,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:40.635201 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:40.866161 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:41.231430 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:33:41.415445 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:33:41.424360 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] Sync routers for ids ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:33:41.430773 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] 10.222.0.82 "PUT /v2.0/routers/d41c5f32-65d4-42ea-8e08-4ee398ba1a44/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7650907 May 20 20:33:41.431034 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42622) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:41.438326 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] Routers {'d41c5f32-65d4-42ea-8e08-4ee398ba1a44'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:33:41.439147 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:33:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:41.564207 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d5bffc3e-0ae3-44f2-b89d-5b9d3f3bfd84 req-07b64706-b637-494a-b917-e0e03ff64fa4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 210 time: 0.0447960 May 20 20:33:41.616851 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks [] for router, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:41.621453 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] Set router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:33:41.904380 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:41.942989 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:33:40Z', 'revision_number': 5, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port': {'id': '1e1ad36c-3452-4567-9c16-3d7790968cda', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:41.946772 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] Checking router: d41c5f32-65d4-42ea-8e08-4ee398ba1a44 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:33:41.954892 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] Routers {'d41c5f32-65d4-42ea-8e08-4ee398ba1a44'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:33:41.955480 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:33:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:41.980054 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Deleting port 1e1ad36c-3452-4567-9c16-3d7790968cda {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:33:41.980648 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.108681 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] Set router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 gateway port host: None {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:33:42.108938 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] For port 1e1ad36c-3452-4567-9c16-3d7790968cda, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=1e1ad36c-3452-4567-9c16-3d7790968cda,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:42.109228 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.217357 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:33:41Z', 'revision_number': 6, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:42.221320 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e7ddb14-9c7e-4870-b457-d966b8ae3f5a None None] The sync data for ids ['d41c5f32-65d4-42ea-8e08-4ee398ba1a44'] in dv-cinder-784623-13-iscsi is: [{'id': 'd41c5f32-65d4-42ea-8e08-4ee398ba1a44', 'name': 'tempest-ServerRescueNegativeTestJSON-880066623-router', 'tenant_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:33:41Z', 'revision_number': 6, 'project_id': 'd7d330ce02bc4a5b849c6cd53ef67558', 'gw_port_host': None}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:33:42.232426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Calling delete_port for 1e1ad36c-3452-4567-9c16-3d7790968cda owned by network:router_gateway {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:33:42.376753 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.381391 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-50a2ab75-4145-4dfb-8543-326131582232 tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:42.424110 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Pushing event deleted for resources: {'Port': ['ID=1e1ad36c-3452-4567-9c16-3d7790968cda,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:42.427364 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:42.524682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.753021 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.756428 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-50c18628-537f-4954-be7f-4217d1d6d52e req-67139131-3077-40cc-a743-9b10d48d2d2d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 210 time: 0.1127467 May 20 20:33:42.757479 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.844674 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.845202 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Fanout notify agent at l3_agent the message router_deleted on router d41c5f32-65d4-42ea-8e08-4ee398ba1a44 {{(pid=91646) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:33:42.858573 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.859684 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] 10.222.0.82 "DELETE /v2.0/routers/d41c5f32-65d4-42ea-8e08-4ee398ba1a44 HTTP/1.1" status: 204 len: 168 time: 1.4277532 May 20 20:33:42.862234 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42640) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:42.924885 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Deleting subnet 2ad34b95-1b62-4f29-a7ba-63bf116ecc64 {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:33:42.927734 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:42.977289 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.032730 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.390235 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.394787 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:43.430673 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.433132 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2ad34b95-1b62-4f29-a7ba-63bf116ecc64,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:43.436178 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:43.439891 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-50556a8a-6695-4cb1-b93e-f890c80287dc admin admin] 10.222.0.82 "DELETE /v2.0/subnets/2ad34b95-1b62-4f29-a7ba-63bf116ecc64 HTTP/1.1" status: 204 len: 168 time: 0.5767033 May 20 20:33:43.443747 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42646) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:43.550689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.674504 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.688106 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ab99f46-8cd1-404d-95ae-c95a8ddd9d72']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:43.699815 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:43.700106 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a7f5843a-4d24-4474-8e1a-3683e9d0f8a4') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:33:43.713529 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.730227 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.736442 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Releasing vlan 833 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:33:43.736821 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:33:43.750262 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:33:43.862591 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1e1ad36c-3452-4567-9c16-3d7790968cda no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:33:43.881230 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c9900301-2b16-43b7-b422-470a4f84c5bf req-57e0891c-d1fc-4550-a099-8ae212c05fb4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 210 time: 0.0579879 May 20 20:33:43.886141 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.901530 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:43.905516 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e333a13d-1e00-4924-a51f-ebf7c0cb2f7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:43.908753 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 1e1ad36c-3452-4567-9c16-3d7790968cda {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:33:43.909101 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1e1ad36c-3452-4567-9c16-3d7790968cda not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:33:43.909547 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device c0fdfd3a-cf39-40ab-842f-b7613dba71a5 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:33:43.927031 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Pushing event deleted for resources: {'Network': ['ID=4ab99f46-8cd1-404d-95ae-c95a8ddd9d72,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:43.929481 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:43.935962 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-852d2433-e386-4e2b-bb1c-14ed8faa2500 admin admin] 10.222.0.82 "DELETE /v2.0/networks/4ab99f46-8cd1-404d-95ae-c95a8ddd9d72 HTTP/1.1" status: 204 len: 168 time: 0.4911354 May 20 20:33:43.942716 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: c0fdfd3a-cf39-40ab-842f-b7613dba71a5 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:33:43.943062 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device c0fdfd3a-cf39-40ab-842f-b7613dba71a5 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:33:44.056755 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42658) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:44.108020 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fdd6b950-4eb0-499a-bf18-0b60764015b3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d7d330ce02bc4a5b849c6cd53ef67558&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0499816 May 20 20:33:44.110349 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42662) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:44.172375 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:44.198551 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:44.251902 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:44.256500 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-99fceacb-c67c-436d-8e4e-b34a1adcc585 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:44.270395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:44.273032 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:44.286136 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:44.287213 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9a4d9c1c-44fb-4fcc-a873-f720df1ba6d2 HTTP/1.1" status: 204 len: 168 time: 0.1759369 May 20 20:33:45.027864 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:45.055787 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-81b5b7a1-abcd-401f-b9ba-f09adc53a569 req-f1f76a1a-858a-46b6-82ac-7e50eb8602b0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 210 time: 0.0521829 May 20 20:33:46.035233 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-8d07d302-8d88-4d05-ac1d-8a1ffdf0a082 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:46.037365 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-8d07d302-8d88-4d05-ac1d-8a1ffdf0a082 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 817 time: 0.1532810 May 20 20:33:46.103998 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d2e31e4f-241e-4ea6-95fc-e730e2953f69 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:33:46.119493 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d2e31e4f-241e-4ea6-95fc-e730e2953f69 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:33:46.120693 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d2e31e4f-241e-4ea6-95fc-e730e2953f69 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 380 time: 0.0660717 May 20 20:33:46.147560 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'port': {'device_id': '752aab2d-e84c-40e9-9518-5a7a71776443', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'admin_state_up': True, 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'security_groups': ['10c3893a-57c7-4733-9ee1-08e1c9a8bd72']}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:33:46.240165 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-730bd7dc-96f3-4c94-8781-6fe1f2539b31 req-7c51cfb1-5389-43ba-9242-056272af5886 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 210 time: 0.0543931 May 20 20:33:46.306962 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:46.319919 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:46.340767 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Made reservation on behalf of d5d038c87b86437990c22a9e55b308b6 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:33:46.344706 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:46.532591 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Allocated IP 172.20.0.14 (5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528/113ead2b-c65c-4cf9-b6ed-724ff34a0db1/5c067b29-7c3f-4485-a9cb-8822d9b39a76) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:33:46.723670 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:46.741586 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Transition to ACTIVE for port object 5c067b29-7c3f-4485-a9cb-8822d9b39a76 will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:33:46.764769 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:46.770248 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:46.833516 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:33:46.836977 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:33:46.840720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:33:46.874262 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:46.881403 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:46.911605 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:46.912230 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:46.938048 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7983983 May 20 20:33:46.959293 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Request body: {'port': {'device_id': '752aab2d-e84c-40e9-9518-5a7a71776443', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:33:47.076207 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:47.110146 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-acb8b483-6c2e-45fc-b11e-878374b695d3 None None] Provisioning for port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:33:47.114820 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-acb8b483-6c2e-45fc-b11e-878374b695d3 None None] Provisioning complete for port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:33:47.115191 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acb8b483-6c2e-45fc-b11e-878374b695d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:47.169230 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-acb8b483-6c2e-45fc-b11e-878374b695d3 None None] Port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:33:47.465559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c067b29-7c3f-4485-a9cb-8822d9b39a76 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:33:47.475743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:47.496128 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Transition to ACTIVE for port object 5c067b29-7c3f-4485-a9cb-8822d9b39a76 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:33:47.505514 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:47.516906 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71918226-d94f-4da5-b586-eb024b4e41e0 req-1e93fa82-c5c8-4755-b78b-814ab9cd2bc5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:47.517613 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-71918226-d94f-4da5-b586-eb024b4e41e0 req-1e93fa82-c5c8-4755-b78b-814ab9cd2bc5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:33:47.521918 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-901096f1-1b6c-4450-88ab-d3f284e7e2fe tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:47.755375 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-71918226-d94f-4da5-b586-eb024b4e41e0 req-1e93fa82-c5c8-4755-b78b-814ab9cd2bc5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:33:47.756540 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71918226-d94f-4da5-b586-eb024b4e41e0 req-1e93fa82-c5c8-4755-b78b-814ab9cd2bc5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 932 time: 0.3983574 May 20 20:33:47.846505 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:47.856328 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.334s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:47.901675 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71918226-d94f-4da5-b586-eb024b4e41e0 req-e9c13f26-bfb2-4558-bf7d-3aa9db590aaa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1055660 May 20 20:33:47.911876 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Attempting to bind port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:33:47.912216 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Attempting to bind port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:33:47.912537 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Attempting to bind port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:33:47.918384 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:33:47.918703 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Attempting to bind port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 on network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:33:47.925043 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 33, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:33:47.925043 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Checking segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:33:47.925043 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Bound using segment: {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:33:47.925410 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Bound port: 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1e05f149-338e-4199-8c1b-ffbf3489ad6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:33:47.925751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:48.035008 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:33:48.039582 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:33:48.048984 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:48.055719 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cdf3f150-1ca3-40bf-837c-30707a4008a7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:48.130150 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:48.130754 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:48.132118 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] 10.222.0.69 "PUT /v2.0/ports/5c067b29-7c3f-4485-a9cb-8822d9b39a76 HTTP/1.1" status: 200 len: 1094 time: 1.1775341 May 20 20:33:48.133159 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:33:48.155962 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:48.159590 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:48.216073 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'status': 'completed', 'code': 200} May 20 20:33:48.260894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d1b88b74-98fe-4c46-9250-7c6e689dc894 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:48.262404 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d1b88b74-98fe-4c46-9250-7c6e689dc894 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 1097 time: 0.0807040 May 20 20:33:48.345668 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0983c6bc-2503-4b71-a8ba-2e3bebc842d9 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76 HTTP/1.1" status: 200 len: 217 time: 0.0632560 May 20 20:33:48.414653 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0cbc516e-8624-49ec-8ad5-bc86896d1b8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:48.416010 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-0cbc516e-8624-49ec-8ad5-bc86896d1b8e service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0578332 May 20 20:33:48.505237 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d66fa099-8f1b-4e5d-9d47-ee13829de03c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:48.506690 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d66fa099-8f1b-4e5d-9d47-ee13829de03c service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0746810 May 20 20:33:48.650657 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-a8f6c8ee-82da-45dc-b619-4a3edc8a1292 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304181 May 20 20:33:48.788426 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4dcc9524-4b30-405b-a15c-1262aae124ec req-d927bc7e-7fce-41ca-88a4-b9528c7ea8d7 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1254485 May 20 20:33:48.926596 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-026ac75e-76c1-439c-b594-eb1112393587 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:48.928380 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-026ac75e-76c1-439c-b594-eb1112393587 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 1097 time: 0.0714977 May 20 20:33:49.075707 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-e04cb0d4-7e79-4cd0-9f2c-f91b4f60c342 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:49.077216 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-e04cb0d4-7e79-4cd0-9f2c-f91b4f60c342 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1359370 May 20 20:33:49.106771 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a48ad76-e454-4b1f-8f62-1dc03938fc80 req-7cf4cb05-a062-4436-bfc5-277f6016f8c1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:49.108726 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4a48ad76-e454-4b1f-8f62-1dc03938fc80 req-7cf4cb05-a062-4436-bfc5-277f6016f8c1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0853484 May 20 20:33:49.159148 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-484e1761-d88c-4edd-a7e6-eda6f7a85f98 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76 HTTP/1.1" status: 200 len: 217 time: 0.0699289 May 20 20:33:49.280366 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4a48ad76-e454-4b1f-8f62-1dc03938fc80 req-fd762ebd-f4fe-4abc-943f-390273b6e330 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1612940 May 20 20:33:49.324731 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-a0444a0b-bb0b-4f8c-8628-a28787793ccd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:49.326181 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-a0444a0b-bb0b-4f8c-8628-a28787793ccd service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.1353810 May 20 20:33:49.347160 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5211b8e5-536b-4bbb-b4d0-0dc74d1d5d9e req-10e50f46-1b9e-4ae0-98e1-77f79fe39ec8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:49.348644 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5211b8e5-536b-4bbb-b4d0-0dc74d1d5d9e req-10e50f46-1b9e-4ae0-98e1-77f79fe39ec8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.1208601 May 20 20:33:49.442682 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5211b8e5-536b-4bbb-b4d0-0dc74d1d5d9e req-3cc818b0-98b1-44eb-a3f0-f8d462b5639f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0610845 May 20 20:33:49.460051 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-08aeaa88-e480-4fd2-9688-d386fecd7d33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:49.462080 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-08aeaa88-e480-4fd2-9688-d386fecd7d33 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1106012 May 20 20:33:49.716519 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-99303677-8630-4a0d-a040-8ee9e8eacf38 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2314200 May 20 20:33:49.864356 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cd795a9b-70ed-43c1-94e4-13ae70d40abe req-810f6c88-02d8-49c1-841a-8829e20807cb service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1357515 May 20 20:33:50.251166 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42806) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:50.380580 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:50.400079 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:50.403952 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Usage tracker for resource:security_group_rule and tenant:2f3fd5daa7064bcf99edefea331dd9e2 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:50.406647 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:50.412469 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:50.463869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c7ba656-9447-4926-babc-a12c020ec8a1 req-66d8ac38-fc51-42f3-babc-0f8e2c907abb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:50.466323 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1c7ba656-9447-4926-babc-a12c020ec8a1 req-66d8ac38-fc51-42f3-babc-0f8e2c907abb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0821121 May 20 20:33:50.507255 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:50.514447 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:50.522077 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-05185a11-00c1-444e-bb53-193594f17a14 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:50.527634 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1c7ba656-9447-4926-babc-a12c020ec8a1 req-1f2c5ea2-6c44-45bd-bb0d-8d4bfd7a7fc4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546377 May 20 20:33:50.567387 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2f3fd5daa7064bcf99edefea331dd9e2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3150783 May 20 20:33:50.568355 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c5d5c483-0f00-45cb-885c-1bedbc78dee1,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:50.570743 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42816) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:50.574478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cf66e59a-6186-411d-9f36-882a2a9310dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:50.638178 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:50.652471 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70fcad-2a1d-4a49-8215-2d8014ab47e9 req-daa53709-2a39-4015-8cd3-3536251aad47 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:50.653931 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bd70fcad-2a1d-4a49-8215-2d8014ab47e9 req-daa53709-2a39-4015-8cd3-3536251aad47 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0812671 May 20 20:33:50.665150 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:50.703184 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bd70fcad-2a1d-4a49-8215-2d8014ab47e9 req-92152355-f5ef-4ea8-ba60-19ed76067777 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434990 May 20 20:33:50.717561 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:50.721319 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bd3b6c1e-42a2-4d74-b47b-70852bc593df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:50.733053 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5d5c483-0f00-45cb-885c-1bedbc78dee1,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:50.736403 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:50.739613 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:50.740729 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c5d5c483-0f00-45cb-885c-1bedbc78dee1 HTTP/1.1" status: 204 len: 168 time: 0.1690214 May 20 20:33:51.020294 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 42826) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:51.038071 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:51.052869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:33:51.057476 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Usage tracker for resource:security_group_rule and tenant:0771618235804520af9bc2462844ea2f is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:33:51.060252 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:33:51.065791 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:33:51.147564 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:51.151643 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:51.159901 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c38d9ee2-27b6-4e7b-8d93-55829d781268 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:51.202966 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0771618235804520af9bc2462844ea2f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1815169 May 20 20:33:51.204633 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb306068-1d71-4771-a418-41a57b85b0ff,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:51.205493 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42830) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:33:51.208158 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:51.264988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:51.289814 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:51.340631 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:51.345456 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-1bc1920f-5879-4c2e-950c-57fd7a0d3edc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:51.358890 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb306068-1d71-4771-a418-41a57b85b0ff,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:51.361743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:51.365829 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:51.367442 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eb306068-1d71-4771-a418-41a57b85b0ff HTTP/1.1" status: 204 len: 168 time: 0.1604702 May 20 20:33:51.711851 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5d1eaa-f32b-4a06-89ab-9947e5af99af req-8e07bb3a-80a2-463d-a87c-3b28d120f2d4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:51.713285 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a5d1eaa-f32b-4a06-89ab-9947e5af99af req-8e07bb3a-80a2-463d-a87c-3b28d120f2d4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0808606 May 20 20:33:51.763725 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a5d1eaa-f32b-4a06-89ab-9947e5af99af req-1df2c543-e34d-4007-b496-4336fa21e04d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440712 May 20 20:33:51.906874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2edaef7-fd9d-4987-929e-50a540c95478 req-46bc1f5e-a47b-4365-a194-931d6efaeae5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:51.908420 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c2edaef7-fd9d-4987-929e-50a540c95478 req-46bc1f5e-a47b-4365-a194-931d6efaeae5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0873506 May 20 20:33:51.959669 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c2edaef7-fd9d-4987-929e-50a540c95478 req-352bad77-40c3-4454-b430-9a7f9c07bd6c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428712 May 20 20:33:52.174298 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:33:52.314243 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:52.327544 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'port_id': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'mac_address': 'fa:16:3e:18:fe:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 840, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:33:52.387098 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:52.404812 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c067b29-7c3f-4485-a9cb-8822d9b39a76 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:33:52.422280 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:52.426212 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:52.428055 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:52.495415 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:52.502723 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.503066 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.503405 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.503738 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.504097 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.504422 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.504743 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.505063 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.505381 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.505698 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.506160 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.506473 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:33:52.510542 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:52.933870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['5c067b29-7c3f-4485-a9cb-8822d9b39a76'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:33:52.965553 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f5d6d7-0956-461d-9b7b-3efec6abdf15 req-d19dc67f-61cb-4dc1-9875-fe4522cd699a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:52.967964 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f4f5d6d7-0956-461d-9b7b-3efec6abdf15 req-d19dc67f-61cb-4dc1-9875-fe4522cd699a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 945 time: 0.0900698 May 20 20:33:53.018517 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f4f5d6d7-0956-461d-9b7b-3efec6abdf15 req-ce4c3436-7cf5-47e4-af98-0c20d180ffb6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439687 May 20 20:33:53.168240 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8231cc-8543-4686-a95e-5c01060a394c req-5dafbe64-c6ab-4729-bb35-275cd9ef7597 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:53.169821 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e8231cc-8543-4686-a95e-5c01060a394c req-5dafbe64-c6ab-4729-bb35-275cd9ef7597 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0868874 May 20 20:33:53.220327 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e8231cc-8543-4686-a95e-5c01060a394c req-1edd7df4-f7b5-4910-a79b-bb97a8579b1e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444944 May 20 20:33:54.188953 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:33:54.231148 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77bf956-c899-4d2c-bd73-30c1a927fa74 req-3505ef60-2d97-46ea-9b9c-4d5447646638 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:54.232660 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e77bf956-c899-4d2c-bd73-30c1a927fa74 req-3505ef60-2d97-46ea-9b9c-4d5447646638 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 945 time: 0.0925925 May 20 20:33:54.260366 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:33:54.265343 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:33:54.265722 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:54.287544 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e77bf956-c899-4d2c-bd73-30c1a927fa74 req-3e950584-7c54-47b1-96c4-a6686785f4fa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487847 May 20 20:33:54.443987 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:54.451601 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2892b6-c7e6-4a7e-8832-e2b66fc355a7 req-3e6782b9-ec90-4b6d-b06a-755c0bd2c406 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:54.461320 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ac2892b6-c7e6-4a7e-8832-e2b66fc355a7 req-3e6782b9-ec90-4b6d-b06a-755c0bd2c406 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0982671 May 20 20:33:54.494228 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:33:54.512751 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ac2892b6-c7e6-4a7e-8832-e2b66fc355a7 req-28c307e5-84f0-4c5c-a1f0-2b6632e3fed1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502198 May 20 20:33:54.513504 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:33:54.524742 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:33:54.527142 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:33:54.598284 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:33:54.601417 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:33:54.689168 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'code': 200} May 20 20:33:54.962122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ec0e89-513f-43f0-861f-93d169c9a24e req-a72ebdad-d46d-4886-831f-82b7e31a4b21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:54.963592 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f9ec0e89-513f-43f0-861f-93d169c9a24e req-a72ebdad-d46d-4886-831f-82b7e31a4b21 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 1099 time: 0.0770030 May 20 20:33:55.017791 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f9ec0e89-513f-43f0-861f-93d169c9a24e req-b4d12855-b2ed-4a51-8f3d-da4116f00fda service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325236 May 20 20:33:55.478156 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce913f0-a7d4-4792-982c-65a740009119 req-f77ad7c0-7034-45a0-a6e8-b22dc36dcae0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:55.479515 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ce913f0-a7d4-4792-982c-65a740009119 req-f77ad7c0-7034-45a0-a6e8-b22dc36dcae0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0779274 May 20 20:33:55.524158 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ce913f0-a7d4-4792-982c-65a740009119 req-49a43ab6-265a-4695-858c-91c945932083 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387833 May 20 20:33:55.692995 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89907f71-ce74-44e8-a86b-8fd0362222cc req-6cae3824-707e-453e-bf1f-ccb17a5143dc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:55.694444 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-89907f71-ce74-44e8-a86b-8fd0362222cc req-6cae3824-707e-453e-bf1f-ccb17a5143dc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0810649 May 20 20:33:55.740530 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-89907f71-ce74-44e8-a86b-8fd0362222cc req-7242c678-6619-4b9e-8d2b-2aa6285afd60 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397062 May 20 20:33:56.713900 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbbded63-50a4-4d63-80f4-95ad0c96344f req-03d09e5c-b28a-4991-874d-d6e16793d313 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:56.715326 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dbbded63-50a4-4d63-80f4-95ad0c96344f req-03d09e5c-b28a-4991-874d-d6e16793d313 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0836525 May 20 20:33:56.758998 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dbbded63-50a4-4d63-80f4-95ad0c96344f req-871a1dac-d9fc-42c0-a69e-a520d8a5b041 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378859 May 20 20:33:56.929014 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fb3fc14-89da-45d5-80cd-2f17c2f85f0b req-5979e9e1-1f32-4138-8726-f6b5b9870420 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:56.930496 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1fb3fc14-89da-45d5-80cd-2f17c2f85f0b req-5979e9e1-1f32-4138-8726-f6b5b9870420 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0825431 May 20 20:33:56.974722 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1fb3fc14-89da-45d5-80cd-2f17c2f85f0b req-d2e6b8d8-17da-47c7-94fa-c56efb86801c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384805 May 20 20:33:57.952317 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a417d8-b57e-4f13-8411-7377310492c2 req-99e425a0-99d9-449a-a26b-fc5b72721045 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:57.954015 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24a417d8-b57e-4f13-8411-7377310492c2 req-99e425a0-99d9-449a-a26b-fc5b72721045 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0813811 May 20 20:33:58.001268 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24a417d8-b57e-4f13-8411-7377310492c2 req-db3b5680-c840-4a7a-91aa-063877d68a57 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416794 May 20 20:33:58.159076 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbc43b8-1d23-4438-9c43-ccc1f4c0c5a1 req-a48a3c88-8b8b-4c34-a8f7-45f29da18e66 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:58.160537 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-adbc43b8-1d23-4438-9c43-ccc1f4c0c5a1 req-a48a3c88-8b8b-4c34-a8f7-45f29da18e66 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0777738 May 20 20:33:58.205391 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-adbc43b8-1d23-4438-9c43-ccc1f4c0c5a1 req-ef7eead8-08e6-4feb-836b-58668f11b844 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379906 May 20 20:33:59.190099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231d3044-4387-40f1-982b-ea7c25e19e63 req-fc37aa27-e1cb-4688-ae2d-8835ef18ed59 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:59.191089 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-231d3044-4387-40f1-982b-ea7c25e19e63 req-fc37aa27-e1cb-4688-ae2d-8835ef18ed59 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0806334 May 20 20:33:59.237467 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-231d3044-4387-40f1-982b-ea7c25e19e63 req-e23518e4-0633-43db-a99f-1678bb01bfdc tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393307 May 20 20:33:59.395621 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813bee65-ac8a-4a0b-9ecb-17b4b04f88fe req-601f2650-b659-4bde-b07a-e341455444a9 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:33:59.397656 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-813bee65-ac8a-4a0b-9ecb-17b4b04f88fe req-601f2650-b659-4bde-b07a-e341455444a9 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0846620 May 20 20:33:59.442925 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-813bee65-ac8a-4a0b-9ecb-17b4b04f88fe req-7209db28-1199-49d9-8564-20ab54f42eae tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388291 May 20 20:34:00.429797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d42125c-6d10-4666-9e1e-de70286d4a05 req-c819ef64-5c03-4c53-ad96-1e1593e38331 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:00.431242 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d42125c-6d10-4666-9e1e-de70286d4a05 req-c819ef64-5c03-4c53-ad96-1e1593e38331 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0848725 May 20 20:34:00.478407 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2d42125c-6d10-4666-9e1e-de70286d4a05 req-522cd765-6f7a-4bd1-82ab-132ff8886591 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414453 May 20 20:34:00.783655 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4c5725-b06d-4f04-871c-02f23fe9b47c req-cadff898-d022-4bd4-bbde-4cb2e8a44cf4 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:00.785048 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2f4c5725-b06d-4f04-871c-02f23fe9b47c req-cadff898-d022-4bd4-bbde-4cb2e8a44cf4 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0802898 May 20 20:34:00.833350 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2f4c5725-b06d-4f04-871c-02f23fe9b47c req-717febaf-2951-4314-b8ca-e8937021bd05 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422430 May 20 20:34:01.671882 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c67ecc03-30b0-486f-9a8d-11084a4cc7cf req-0d9f77b0-4e22-4bf8-825d-8ff81149b0b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:01.673324 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c67ecc03-30b0-486f-9a8d-11084a4cc7cf req-0d9f77b0-4e22-4bf8-825d-8ff81149b0b6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0797777 May 20 20:34:01.718082 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c67ecc03-30b0-486f-9a8d-11084a4cc7cf req-3a446045-f840-478e-8dcd-4f7b4f8d6fb6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391743 May 20 20:34:01.920275 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc093972-bf02-4a0d-80e1-84537875dc62 req-063903e4-3f1d-400c-9ced-5699c2aa1240 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:01.921869 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-bc093972-bf02-4a0d-80e1-84537875dc62 req-063903e4-3f1d-400c-9ced-5699c2aa1240 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0938947 May 20 20:34:01.930604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 42980) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:01.936175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Request body: {'floatingip': {'port_id': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:34:02.140520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:02.414119 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6169858a-2882-4dec-b323-67092c8dabe5 req-959b7841-445e-42c6-bce0-e2a40139725b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:02.415519 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6169858a-2882-4dec-b323-67092c8dabe5 req-959b7841-445e-42c6-bce0-e2a40139725b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.4187434 May 20 20:34:02.485643 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6169858a-2882-4dec-b323-67092c8dabe5 req-c5fbe5ae-dbef-4c0a-800b-7d67ec884915 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0615203 May 20 20:34:02.815642 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:02.819434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:02.987591 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Floating IP 5a691d52-5dbe-4ea9-bf40-5c0720e43a2d associated. External IP: 172.27.3.48, port: 5c067b29-7c3f-4485-a9cb-8822d9b39a76. May 20 20:34:03.334765 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Router cdb694ee-b9bf-4ffe-895b-e76ca953be5d has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:34:03.611109 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:34:03.616143 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:03.621520 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] Sync routers for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:34:03.630879 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:03.631988 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:33:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:03.675142 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d55a8077-ba68-441e-94f4-9a061c7339b8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "PUT /v2.0/floatingips/5a691d52-5dbe-4ea9-bf40-5c0720e43a2d HTTP/1.1" status: 200 len: 991 time: 1.7433698 May 20 20:34:03.675975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:34:03.676299 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e00e19-855a-4a89-93a6-f773cea020e7 req-4a625396-f8a0-4e0e-bab4-7036ee6c2bd9 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:03.677766 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-04e00e19-855a-4a89-93a6-f773cea020e7 req-4a625396-f8a0-4e0e-bab4-7036ee6c2bd9 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0827887 May 20 20:34:03.728675 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-04e00e19-855a-4a89-93a6-f773cea020e7 req-29194a17-8b51-4e28-9412-3a3b379e0db5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436473 May 20 20:34:03.789781 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'status': 'completed', 'code': 200} May 20 20:34:03.827211 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:04.196410 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '5a691d52-5dbe-4ea9-bf40-5c0720e43a2d', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'floating_ip_address': '172.27.3.48', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'port_id': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'mac_address': 'fa:16:3e:18:fe:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '752aab2d-e84c-40e9-9518-5a7a71776443', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:33:37Z', 'updated_at': '2021-05-20T20:34:02Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:04.200307 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] Checking router: cdb694ee-b9bf-4ffe-895b-e76ca953be5d for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:34:04.209130 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:04.209726 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:33:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:04.387039 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:04.726417 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '5a691d52-5dbe-4ea9-bf40-5c0720e43a2d', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'floating_ip_address': '172.27.3.48', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'port_id': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'mac_address': 'fa:16:3e:18:fe:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '752aab2d-e84c-40e9-9518-5a7a71776443', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:33:37Z', 'updated_at': '2021-05-20T20:34:02Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:04.730449 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0ef8f69-524c-43eb-8407-433fc11d22f0 None None] The sync data for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi is: [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': '5a691d52-5dbe-4ea9-bf40-5c0720e43a2d', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'floating_ip_address': '172.27.3.48', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'port_id': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'mac_address': 'fa:16:3e:18:fe:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '752aab2d-e84c-40e9-9518-5a7a71776443', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:33:37Z', 'updated_at': '2021-05-20T20:34:02Z', 'revision_number': 1, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:34:04.761981 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-fb5a754e-084f-43a1-9a84-b9cc92585ca3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:04.927033 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d630d6d4-e713-4fc6-9da9-3937f9c4baab req-611bbb98-45f8-4592-ab6a-6998c7d0f573 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:04.929921 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d630d6d4-e713-4fc6-9da9-3937f9c4baab req-611bbb98-45f8-4592-ab6a-6998c7d0f573 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0832939 May 20 20:34:04.930180 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9201f3a4-bd48-4165-85cd-eff174cdc2c3 None None] New status for floating IP 5a691d52-5dbe-4ea9-bf40-5c0720e43a2d: ACTIVE {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:34:04.980703 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d630d6d4-e713-4fc6-9da9-3937f9c4baab req-fa093ad0-2d87-4508-9be2-9a1e8df50545 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394044 May 20 20:34:06.170574 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76d41441-1095-4fe2-b61a-927ad6587c05 req-77e5e6a2-4c86-4274-b2c5-7930371f1da1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:06.172027 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-76d41441-1095-4fe2-b61a-927ad6587c05 req-77e5e6a2-4c86-4274-b2c5-7930371f1da1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0832324 May 20 20:34:06.218963 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-76d41441-1095-4fe2-b61a-927ad6587c05 req-0ca938b5-a448-4984-a9ea-9c2bb3905c92 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409822 May 20 20:34:06.917553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-bfa52e38-15cc-4e66-a711-8f7d5d2d9cff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:06.919523 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-bfa52e38-15cc-4e66-a711-8f7d5d2d9cff service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 1099 time: 0.0726240 May 20 20:34:07.066319 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-98ef4335-a5d7-4954-9d95-cb551dc5afe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:07.067777 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-98ef4335-a5d7-4954-9d95-cb551dc5afe3 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1293209 May 20 20:34:07.184400 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-87fee404-a2b9-44b6-a246-5456f7df8bb8 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76 HTTP/1.1" status: 200 len: 1001 time: 0.0986910 May 20 20:34:07.218083 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:07.269423 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-a069d8d9-f3f7-49a8-b583-e8777ace9017 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:07.270970 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-a069d8d9-f3f7-49a8-b583-e8777ace9017 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0658438 May 20 20:34:07.363433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-439f4845-ce0b-4ee2-8e03-1aa259ba22b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:07.365025 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-439f4845-ce0b-4ee2-8e03-1aa259ba22b7 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0732944 May 20 20:34:07.405578 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bcd272-e3ed-4619-8388-40aea8778d2a req-453bdbf7-966c-43de-b513-25f50e7f6c47 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:07.407048 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-81bcd272-e3ed-4619-8388-40aea8778d2a req-453bdbf7-966c-43de-b513-25f50e7f6c47 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0787716 May 20 20:34:07.452968 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-81bcd272-e3ed-4619-8388-40aea8778d2a req-041131eb-3835-433b-8ff5-7f1be3e4e358 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399520 May 20 20:34:07.492812 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4cb6d644-be18-4c8b-aeb3-8a8259871819 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:07.515148 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-3d3f4f98-1e5b-4614-b98c-ba446f96057e service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1285257 May 20 20:34:07.656362 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-375d2424-4617-44b3-bff7-3b902a1b7f2d req-31f6cc1b-d4ca-4ed3-9717-74afc6409678 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284027 May 20 20:34:08.283266 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:08.490329 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-e5103761-d47f-4d9a-9dbc-30a84be9ceea tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2030092252&fields=id&tenant_id=7c0b04802f8b42819b613e195b66efb7 HTTP/1.1" status: 200 len: 267 time: 0.0438988 May 20 20:34:08.578532 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-ecb9309d-479c-4de3-bd6b-52c085d9adbe tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:08.584309 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-ecb9309d-479c-4de3-bd6b-52c085d9adbe tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 984 time: 0.0874882 May 20 20:34:08.591634 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Request body: {'port': {'security_groups': ['a280c5d3-c0db-4e96-8163-d76c7fb84fac']}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:34:08.654550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2e5c86-f807-4619-9727-431c665d9bcc req-a03bd1c5-6392-4791-a084-c1b2bd86ee2f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:08.656041 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0a2e5c86-f807-4619-9727-431c665d9bcc req-a03bd1c5-6392-4791-a084-c1b2bd86ee2f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0829747 May 20 20:34:08.708513 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0a2e5c86-f807-4619-9727-431c665d9bcc req-c9d8a0f3-7234-42ee-a7e4-cd4119ae4288 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466266 May 20 20:34:08.792220 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.034095 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:09.060936 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.066534 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3178412'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.072582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-028e6411-aa17-441d-ac44-08132491cc6f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:09.094300 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['0d67a0d3-7c10-49ac-89c0-e4f771176280'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:34:09.139979 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:09.140658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.142042 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-142267ec-00ac-4922-83b4-d5ff23e96aee req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "PUT /v2.0/ports/0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 942 time: 0.5550525 May 20 20:34:09.143255 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:34:09.150009 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43056) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:09.161917 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event updated for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=7']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:09.173198 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.173374 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.173941 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.174507 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.175056 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.175605 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.176168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.177035 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.177582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.178122 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.179580 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.180157 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.194067 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:09.300372 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.336717 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['0d67a0d3-7c10-49ac-89c0-e4f771176280'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:34:09.337206 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'status': 'completed', 'code': 200} May 20 20:34:09.348783 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.502531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a109ca73-3468-4478-bb36-d28d44d25deb req-477536ae-e23b-499b-97da-c2d9a9fbcbf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:09.504244 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a109ca73-3468-4478-bb36-d28d44d25deb req-477536ae-e23b-499b-97da-c2d9a9fbcbf3 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1098 time: 0.1261122 May 20 20:34:09.505694 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.510879 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c596d399-d88b-42f6-95cc-6233e1ec2c60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:09.537765 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-d7085512-7e4c-40d7-91cb-b9a3a6158bd4 None None] Provisioning complete for port 0d67a0d3-7c10-49ac-89c0-e4f771176280 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:34:09.539143 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d7085512-7e4c-40d7-91cb-b9a3a6158bd4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.547568 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba6afe29-4227-4612-ab4e-56eb5a2d6275,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:09.573155 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.573677 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.574171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.574636 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.575100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.575555 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.576088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.576543 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.577012 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.577462 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.577911 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.578395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:34:09.581895 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:09.596723 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.598187 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "DELETE /v2.0/security-groups/ba6afe29-4227-4612-ab4e-56eb5a2d6275 HTTP/1.1" status: 204 len: 168 time: 0.4468582 May 20 20:34:09.601923 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43072) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:09.892426 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43084) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:09.906921 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:09.920896 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a109ca73-3468-4478-bb36-d28d44d25deb req-648896f6-47a5-4570-8827-2a58a0aff9ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:09.922364 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a109ca73-3468-4478-bb36-d28d44d25deb req-648896f6-47a5-4570-8827-2a58a0aff9ae service neutron] 10.222.0.69 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 915 time: 0.4000778 May 20 20:34:10.022322 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.039658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:34:10.044747 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Usage tracker for resource:security_group_rule and tenant:871a28e00dfa4bf198710a3e65292e70 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:34:10.047878 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:34:10.053854 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:34:10.134705 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.138898 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.151268 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d7ea548d-3a97-4887-bb51-0c37cc55293a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:10.194278 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=871a28e00dfa4bf198710a3e65292e70&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2976096 May 20 20:34:10.194278 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e5f159f-50bf-45ab-a5fd-22f9cd0f5761,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:10.195110 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43092) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:10.218017 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:10.243012 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a109ca73-3468-4478-bb36-d28d44d25deb req-3ea07e95-7e9d-4882-869f-1bc9f2f75ad3 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 1001 time: 0.1977787 May 20 20:34:10.259640 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1072ce-b0b5-43c4-834e-7199c41055a7 req-785a71c3-6f05-49ff-9a49-10199da2fc98 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:10.261766 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4c1072ce-b0b5-43c4-834e-7199c41055a7 req-785a71c3-6f05-49ff-9a49-10199da2fc98 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.3875866 May 20 20:34:10.267963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.295833 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.352753 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.355399 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Deleting port 080bba6c-30e4-43d8-a64f-1ffc4b054de9 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:10.355736 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.357843 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3d5d74ce-4de2-4ab0-862b-1e12e9e57577 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:10.370520 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e5f159f-50bf-45ab-a5fd-22f9cd0f5761,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:10.373349 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:10.374804 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a109ca73-3468-4478-bb36-d28d44d25deb req-b0a2dccb-6124-4d80-a4df-ac507540fc16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:10.376259 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a109ca73-3468-4478-bb36-d28d44d25deb req-b0a2dccb-6124-4d80-a4df-ac507540fc16 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 200 len: 853 time: 0.1122739 May 20 20:34:10.381766 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.383622 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1e5f159f-50bf-45ab-a5fd-22f9cd0f5761 HTTP/1.1" status: 204 len: 168 time: 0.1767778 May 20 20:34:10.397137 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4c1072ce-b0b5-43c4-834e-7199c41055a7 req-62d914c8-f14c-408c-9fb2-f7a41f70b602 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0948677 May 20 20:34:10.546242 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.546466 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.561458 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a109ca73-3468-4478-bb36-d28d44d25deb req-545a3adc-9737-4c15-a561-01af84a9b3aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:10.562908 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a109ca73-3468-4478-bb36-d28d44d25deb req-545a3adc-9737-4c15-a561-01af84a9b3aa service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1692934 May 20 20:34:10.681228 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43100) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:10.696878 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Calling delete_port for 080bba6c-30e4-43d8-a64f-1ffc4b054de9 owned by network:floatingip {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:10.699359 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.714659 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:34:10.718440 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Usage tracker for resource:security_group_rule and tenant:7ef4eaac8f2545fc8885fa8673a6a43e is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:34:10.721278 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:34:10.727858 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:34:10.828254 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.831842 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a109ca73-3468-4478-bb36-d28d44d25deb req-5bb383f4-abdd-4ddf-87a2-2e9d201a6050 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2163396 May 20 20:34:10.833861 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.844430 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-94a47d37-8ba8-4618-b3a5-9a548deaf8a9 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:10.887967 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7ef4eaac8f2545fc8885fa8673a6a43e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2031400 May 20 20:34:10.889010 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43108) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:10.894456 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aecdf0ad-9fc3-40fa-bdf4-465d20e6fa27,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:10.917557 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:10.966496 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f3daea62-5e87-445b-a94c-f87810b77c84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:10.996502 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f3daea62-5e87-445b-a94c-f87810b77c84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:11.016739 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a109ca73-3468-4478-bb36-d28d44d25deb req-6c7d924e-9c54-4724-84c2-77f81e33ea3b service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1713636 May 20 20:34:11.050957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:11.056907 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-669f2d02-d7b4-48ec-9abf-6576f9e0990e tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:11.057544 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f3daea62-5e87-445b-a94c-f87810b77c84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:11.062506 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ee49316d-14c4-47a3-be46-cb5042331c6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:11.076018 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3daea62-5e87-445b-a94c-f87810b77c84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aecdf0ad-9fc3-40fa-bdf4-465d20e6fa27,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:11.078552 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f3daea62-5e87-445b-a94c-f87810b77c84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:11.079742 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f3daea62-5e87-445b-a94c-f87810b77c84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:11.083421 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f3daea62-5e87-445b-a94c-f87810b77c84 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/aecdf0ad-9fc3-40fa-bdf4-465d20e6fa27 HTTP/1.1" status: 204 len: 168 time: 0.1908886 May 20 20:34:11.135478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event deleted for resources: {'Port': ['ID=080bba6c-30e4-43d8-a64f-1ffc4b054de9,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:11.138529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:11.211607 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks [] for floatingip, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:11.212181 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Floating IP dea3a238-b599-4224-b9ac-ece75c719b28 disassociated (deleted). External IP: 172.27.3.145, port: 0d67a0d3-7c10-49ac-89c0-e4f771176280. May 20 20:34:11.682075 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-043a198f-9be0-4025-9880-226daa84664c service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3824303 May 20 20:34:11.859100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae1013d-d777-4dc8-b6ff-1a8b0d5fd86d req-a63de598-ba24-41d0-9802-5276d35be818 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:11.860550 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2ae1013d-d777-4dc8-b6ff-1a8b0d5fd86d req-a63de598-ba24-41d0-9802-5276d35be818 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.2586229 May 20 20:34:11.862317 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Router 9e724689-d805-445f-92ab-29fb6d9724fc has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:34:11.993956 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-ffcd2f53-7126-4b8d-ab91-e9b26e0ea2ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:11.995489 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-ffcd2f53-7126-4b8d-ab91-e9b26e0ea2ee service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 1099 time: 0.2473116 May 20 20:34:12.003045 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2ae1013d-d777-4dc8-b6ff-1a8b0d5fd86d req-80c90f99-0e48-4ca9-ad06-a367ce79872c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1347234 May 20 20:34:12.198603 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:34:12.247961 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] Sync routers for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:34:12.250842 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:12.261228 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:12.261983 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:12.293921 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-871b2b9c-5ece-436e-9990-7b06d9e99033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:12.295408 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-871b2b9c-5ece-436e-9990-7b06d9e99033 service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.2212601 May 20 20:34:12.414565 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "DELETE /v2.0/floatingips/dea3a238-b599-4224-b9ac-ece75c719b28 HTTP/1.1" status: 204 len: 168 time: 2.8080764 May 20 20:34:12.420403 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:34:12.457061 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-569a8688-8a14-4e10-a594-dcb6071a71b1 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 200 len: 1001 time: 0.1441019 May 20 20:34:12.604051 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:12.639304 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'status': 'completed', 'code': 200} May 20 20:34:12.685584 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-a8c7ac36-b6d5-4f26-bf76-70126cc0a5cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:12.687026 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-a8c7ac36-b6d5-4f26-bf76-70126cc0a5cc service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.2157283 May 20 20:34:12.697257 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-44b58c7e-8eaa-4a4b-b37b-23ad507eddde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:12.698769 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-44b58c7e-8eaa-4a4b-b37b-23ad507eddde service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7c0b04802f8b42819b613e195b66efb7&device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 1098 time: 0.1459739 May 20 20:34:12.800939 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:34:12.926368 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-e3129d3f-60ee-4bd4-a3fc-6271280b808e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:12.927780 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-e3129d3f-60ee-4bd4-a3fc-6271280b808e service neutron] 10.222.0.69 "GET /v2.0/networks?id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 200 len: 915 time: 0.1764619 May 20 20:34:12.930394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-d442fe76-3120-423e-8f7c-c0113b0677e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:12.931811 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-d442fe76-3120-423e-8f7c-c0113b0677e7 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.2165949 May 20 20:34:12.981380 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 5, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:12.985281 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] Checking router: 9e724689-d805-445f-92ab-29fb6d9724fc for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:34:12.994332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:12.994931 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:13.054235 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-8a557472-845c-418a-a5cf-ea528d7489f7 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 200 len: 217 time: 0.0888302 May 20 20:34:13.181453 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:13.215151 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-f9a44555-c47d-40bd-84ba-d2f22b21cbd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:13.216661 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-f9a44555-c47d-40bd-84ba-d2f22b21cbd7 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 200 len: 853 time: 0.0957727 May 20 20:34:13.218655 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-03148818-e3b4-4514-8f64-48f1dfccc2a7 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1995540 May 20 20:34:13.521106 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 5, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:13.525937 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc64d47c-d36e-45e0-93ef-47da2752fb0b None None] The sync data for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi is: [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:29:02Z', 'revision_number': 4, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '93b0417e-99f4-4721-9a41-9257895317c2', 'name': '', 'network_id': '6a4c09f9-50d0-476e-a4d9-6333a5ec1132', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'mac_address': 'fa:16:3e:f3:a5:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:01Z', 'updated_at': '2021-05-20T20:29:12Z', 'revision_number': 5, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'subnets': [{'id': 'cb4537c7-816d-4786-a91f-df295ad528b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:34:13.631196 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e76456b0-b8e9-446d-a28f-cbdb31b5bafb req-db29ed6f-4474-4848-857a-9d30a3b34991 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3709490 May 20 20:34:13.654482 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-26a1b06b-3f25-4603-a251-60cde67f977a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:13.655951 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-26a1b06b-3f25-4603-a251-60cde67f977a service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=6a4c09f9-50d0-476e-a4d9-6333a5ec1132&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.3970261 May 20 20:34:13.663494 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6159b52e-a637-4be1-ba72-2a4e89b1917d req-a99da746-7e26-4f02-aa7d-ac27bd9c1bf5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:13.664964 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6159b52e-a637-4be1-ba72-2a4e89b1917d req-a99da746-7e26-4f02-aa7d-ac27bd9c1bf5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.1326227 May 20 20:34:13.739515 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43176) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:13.817217 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6159b52e-a637-4be1-ba72-2a4e89b1917d req-54220bca-e146-485f-ae18-2c334f87f467 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1455050 May 20 20:34:13.872094 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e766adbe-969b-444b-ab87-cbb4849febb0 None None] New status for floating IP dea3a238-b599-4224-b9ac-ece75c719b28: DOWN {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:34:13.877012 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-4e860dd0-ec15-4fa9-ba6b-d5739a37c1d5 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1890900 May 20 20:34:13.906585 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:13.939658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:34:13.945004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Usage tracker for resource:security_group_rule and tenant:f36d305a520e4c8280b9656915f322fb is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:34:13.948455 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:34:13.955390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:34:14.077241 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:14.077540 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8ab3b27b-2dee-43f9-9f43-3b8d2ce21c5b req-86ae992a-6bc4-45af-a81b-efe8f5c51795 service neutron] 10.222.0.69 "GET /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1874151 May 20 20:34:14.082398 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:14.093939 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6219c49d-f333-4153-846f-e20ba4c15d11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:14.140920 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f36d305a520e4c8280b9656915f322fb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4002037 May 20 20:34:14.142558 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f8e2204-5a79-47e2-9019-34b08e4f9ca2,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:14.143534 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43190) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:14.169242 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:14.213363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:14.239998 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:14.299809 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:14.307905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4c9e0ce0-f048-4c5e-a891-d6f8a6dee7b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:14.324959 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:14.324959 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9f8e2204-5a79-47e2-9019-34b08e4f9ca2 HTTP/1.1" status: 204 len: 168 time: 0.1782086 May 20 20:34:14.324959 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f8e2204-5a79-47e2-9019-34b08e4f9ca2,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:14.327706 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:15.007800 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89093058-a186-4915-8733-2ccc4dda611c req-c24f051c-050b-4df1-a4df-d2c05dd890d8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:15.009224 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-89093058-a186-4915-8733-2ccc4dda611c req-c24f051c-050b-4df1-a4df-d2c05dd890d8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0789573 May 20 20:34:15.048009 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:15.059089 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-89093058-a186-4915-8733-2ccc4dda611c req-89e13d4c-e1c0-46a4-862a-e98d7178054f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441837 May 20 20:34:16.299741 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-0e036fd7-7b89-4746-b880-4942eb102418 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:16.301247 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-0e036fd7-7b89-4746-b880-4942eb102418 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1098 time: 0.1353583 May 20 20:34:16.309324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabea660-44dd-41cf-9162-42937272b507 req-09103684-0393-4269-a685-305be011d109 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:16.310652 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cabea660-44dd-41cf-9162-42937272b507 req-09103684-0393-4269-a685-305be011d109 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.1100383 May 20 20:34:16.437140 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cabea660-44dd-41cf-9162-42937272b507 req-a69a1cc3-43c1-42cd-8cb0-3785fc7f2948 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1206090 May 20 20:34:16.476091 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-04e73fbd-edc6-40c5-91f0-16428b65f992 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:16.477516 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-04e73fbd-edc6-40c5-91f0-16428b65f992 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 909 time: 0.1594386 May 20 20:34:16.590692 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-592d1995-b429-49ac-80de-93b4536e83c3 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 1001 time: 0.0964503 May 20 20:34:16.660213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-3a7607b8-a627-4818-87ac-57bc5d65ac97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:16.661631 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-3a7607b8-a627-4818-87ac-57bc5d65ac97 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 200 len: 847 time: 0.0595031 May 20 20:34:16.740810 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-8fe8003d-913e-47fe-9ae1-69cfaaa6f419 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:16.742150 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-8fe8003d-913e-47fe-9ae1-69cfaaa6f419 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9c4884cd-a197-48ab-a497-3c07afe55035&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0681174 May 20 20:34:16.878643 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-83fba04a-64b6-4924-b88d-f6c18acf72fd service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1244102 May 20 20:34:17.015156 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40870695-da9d-4c01-aa41-d0ff4dcbed9f req-853d5676-932a-4276-b88d-1e98b6db160a service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1233945 May 20 20:34:17.625345 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44089689-acbb-4f09-aef1-89f2c9f938e9 req-cf929736-4d48-44d1-a2b5-b2116f042ed5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:17.626781 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44089689-acbb-4f09-aef1-89f2c9f938e9 req-cf929736-4d48-44d1-a2b5-b2116f042ed5 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0823786 May 20 20:34:17.673659 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44089689-acbb-4f09-aef1-89f2c9f938e9 req-816c43b1-937f-460c-863e-498a3d3fa36f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409350 May 20 20:34:18.859978 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-325612e4-b821-494f-a6e4-bfbdbcb2e953 req-1cd3b925-0541-4fdf-ab96-e470973f7be4 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:18.861398 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-325612e4-b821-494f-a6e4-bfbdbcb2e953 req-1cd3b925-0541-4fdf-ab96-e470973f7be4 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0793226 May 20 20:34:18.909539 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-325612e4-b821-494f-a6e4-bfbdbcb2e953 req-770ec312-9aa2-4a56-9fff-4d96bf9d0b0f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412953 May 20 20:34:20.190845 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dac140-b8e6-434c-a3e0-1c4aad289a3c req-be5a451e-3571-4d97-9ac5-eb93903cc39a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:20.192229 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c7dac140-b8e6-434c-a3e0-1c4aad289a3c req-be5a451e-3571-4d97-9ac5-eb93903cc39a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.1754444 May 20 20:34:20.237992 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c7dac140-b8e6-434c-a3e0-1c4aad289a3c req-1bede4a5-ad17-4cde-93ee-a550cc24956d tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393195 May 20 20:34:21.422861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6d7584-9748-4870-8a69-da05863a2957 req-fe70d6f1-1a05-43da-9ca5-dde80ccfa57a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:21.424303 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fd6d7584-9748-4870-8a69-da05863a2957 req-fe70d6f1-1a05-43da-9ca5-dde80ccfa57a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0798151 May 20 20:34:21.470452 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fd6d7584-9748-4870-8a69-da05863a2957 req-0a632033-cb1a-45f4-83fb-a15171a54de0 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399711 May 20 20:34:22.658987 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3b1e852-934c-46d4-a389-85e41f193963 req-83301769-bc16-41cf-913b-7c62b5f9003c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:22.660435 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e3b1e852-934c-46d4-a389-85e41f193963 req-83301769-bc16-41cf-913b-7c62b5f9003c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0775728 May 20 20:34:22.711681 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e3b1e852-934c-46d4-a389-85e41f193963 req-71d674b9-68ef-4c2b-9d9e-c8ed2fe0d1ce tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445049 May 20 20:34:23.922405 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6127b09-aebc-42dc-aa37-883316cd9b93 req-5d2c6d69-05ab-4daf-9758-176095bd94e0 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:23.924157 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e6127b09-aebc-42dc-aa37-883316cd9b93 req-5d2c6d69-05ab-4daf-9758-176095bd94e0 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0952406 May 20 20:34:23.973536 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e6127b09-aebc-42dc-aa37-883316cd9b93 req-d08fb99c-9fd2-4b6c-a4aa-190b3c7f5d41 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408502 May 20 20:34:25.158339 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d771fc3-b9a7-4a67-8130-2189f84ab21d req-8151d61e-48eb-4997-b657-1abd402c7f8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:25.159815 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5d771fc3-b9a7-4a67-8130-2189f84ab21d req-8151d61e-48eb-4997-b657-1abd402c7f8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0786078 May 20 20:34:25.208449 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5d771fc3-b9a7-4a67-8130-2189f84ab21d req-2e1f8ae9-7b4d-4924-a6a1-1123c47d8191 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423665 May 20 20:34:26.393736 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7bdb66d-e687-4706-a304-1eefea31aef6 req-73baa68d-c588-4179-a378-b58fa473f1f8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:26.395183 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e7bdb66d-e687-4706-a304-1eefea31aef6 req-73baa68d-c588-4179-a378-b58fa473f1f8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0782983 May 20 20:34:26.439462 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e7bdb66d-e687-4706-a304-1eefea31aef6 req-dbd8ef4f-22ab-424b-917b-e1856459897f tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379963 May 20 20:34:26.775398 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43298) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:26.791832 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75cf9aed-3bb5-4225-a7ce-b4909a74a281 req-011d4707-b1da-4ca7-8af9-fbb64902f540 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:26.793526 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-75cf9aed-3bb5-4225-a7ce-b4909a74a281 req-011d4707-b1da-4ca7-8af9-fbb64902f540 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0835335 May 20 20:34:26.839102 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-75cf9aed-3bb5-4225-a7ce-b4909a74a281 req-ba77d95e-d1ef-4d11-8237-0ba57f6ac29b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395641 May 20 20:34:26.893049 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-e47469c0-3837-4119-b59a-d3f93cb1db4d service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1160188 May 20 20:34:28.029546 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a790186-6f18-4cd9-ad6c-88a055d36a68 req-53c13a01-047f-4198-9e80-9ea6e14907ad tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:28.030905 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a790186-6f18-4cd9-ad6c-88a055d36a68 req-53c13a01-047f-4198-9e80-9ea6e14907ad tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0810559 May 20 20:34:28.075448 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a790186-6f18-4cd9-ad6c-88a055d36a68 req-4bcfc448-4195-4aab-9a21-e4f210fff248 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388515 May 20 20:34:28.682012 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8901084c-f60b-4b41-82bc-2d359b04000f no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:28.798673 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:28.825711 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:34:28.835152 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:28.840462 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:28.842219 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-9b2d28ac-1d81-4c7c-bfda-4c21cc345864 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:28.876352 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f', 'code': 200} May 20 20:34:28.908414 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=6']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:28.911545 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:29.275573 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b439cc2c-d49b-4656-af55-b59ec7c92836 req-391dd8c4-5adc-4032-a1ef-e68507cbd052 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:29.277110 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b439cc2c-d49b-4656-af55-b59ec7c92836 req-391dd8c4-5adc-4032-a1ef-e68507cbd052 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0868831 May 20 20:34:29.336566 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b439cc2c-d49b-4656-af55-b59ec7c92836 req-dd719d5b-bb0e-47a0-a679-36b74b1bfe1a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534899 May 20 20:34:30.276857 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd378b3-43af-459e-ad82-339ddd41ddc7 req-40846cb3-49e0-4b20-a791-c7d97320ac71 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:30.278500 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2fd378b3-43af-459e-ad82-339ddd41ddc7 req-40846cb3-49e0-4b20-a791-c7d97320ac71 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0930817 May 20 20:34:30.330843 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2fd378b3-43af-459e-ad82-339ddd41ddc7 req-7d5152ea-86df-45d6-aaf9-41f387be23f8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458949 May 20 20:34:30.532383 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae24a4d5-d0ff-4cb9-ba4f-5ede1d96e6be req-c6004e58-9054-435f-9a98-acfdea3e85b8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:30.533796 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ae24a4d5-d0ff-4cb9-ba4f-5ede1d96e6be req-c6004e58-9054-435f-9a98-acfdea3e85b8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0811434 May 20 20:34:30.580276 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ae24a4d5-d0ff-4cb9-ba4f-5ede1d96e6be req-3f295a2b-679e-4245-a3dd-d4cc50bcd9e3 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401847 May 20 20:34:31.197818 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-55106722-c6ac-4556-9876-a3037d3baae1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:31.199232 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-55106722-c6ac-4556-9876-a3037d3baae1 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9&tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238 HTTP/1.1" status: 200 len: 1096 time: 0.0742364 May 20 20:34:31.309359 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-6c94cbc0-9ccc-4e25-966c-93c6015f0a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:31.310824 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-6c94cbc0-9ccc-4e25-966c-93c6015f0a02 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1096 time: 0.0727489 May 20 20:34:31.492968 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-edd53974-fb9e-4c10-b450-6f03f955fc53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:31.494533 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-edd53974-fb9e-4c10-b450-6f03f955fc53 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 909 time: 0.1720586 May 20 20:34:31.620950 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-716666f4-b27a-470b-9c5c-33d617c7eab5 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 999 time: 0.1141293 May 20 20:34:31.630004 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23551537-2078-461e-aeea-75b1b880db59 req-e3919dd6-7c2d-4b39-bc59-0aaa774df09d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:31.630704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-23551537-2078-461e-aeea-75b1b880db59 req-e3919dd6-7c2d-4b39-bc59-0aaa774df09d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Synchronizing usage tracker for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:34:31.694179 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-23551537-2078-461e-aeea-75b1b880db59 req-e3919dd6-7c2d-4b39-bc59-0aaa774df09d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Unset dirty status for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:34:31.695544 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-23551537-2078-461e-aeea-75b1b880db59 req-e3919dd6-7c2d-4b39-bc59-0aaa774df09d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.2509742 May 20 20:34:31.700942 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-5de57703-ba26-4b0d-b4a9-1c7c115847a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:31.702306 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-5de57703-ba26-4b0d-b4a9-1c7c115847a8 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 200 len: 847 time: 0.0672276 May 20 20:34:31.776906 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003e5c59-1370-4b2d-b2f1-d8eb3d7f7a27 req-d7793c4a-747f-42a2-a8ed-ca10f8aa02cd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:31.778298 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-003e5c59-1370-4b2d-b2f1-d8eb3d7f7a27 req-d7793c4a-747f-42a2-a8ed-ca10f8aa02cd tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0793741 May 20 20:34:31.796574 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-23551537-2078-461e-aeea-75b1b880db59 req-56c61ff8-bf90-4df1-8fbf-0ad65f9883e8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Synchronizing usage tracker for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:34:31.822582 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-23551537-2078-461e-aeea-75b1b880db59 req-56c61ff8-bf90-4df1-8fbf-0ad65f9883e8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Unset dirty status for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:34:31.823835 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-23551537-2078-461e-aeea-75b1b880db59 req-56c61ff8-bf90-4df1-8fbf-0ad65f9883e8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163695 May 20 20:34:31.828319 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-04159601-adce-4fb8-9c85-ec8e0fea9de0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:31.830123 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-04159601-adce-4fb8-9c85-ec8e0fea9de0 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9c4884cd-a197-48ab-a497-3c07afe55035&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1099455 May 20 20:34:31.845081 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-003e5c59-1370-4b2d-b2f1-d8eb3d7f7a27 req-1042f9bc-5e88-45ce-be1d-29b76c49098a tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606298 May 20 20:34:31.978331 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-64c53071-9daa-4110-9d7d-19eb196ac3d9 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1333170 May 20 20:34:32.133620 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ea52231b-f502-40d3-bc61-86cb3e1c2808 req-5d7e1e0e-5f77-42da-9f19-d909c74aaac7 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1315758 May 20 20:34:33.023845 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda698b2-79e6-4786-a3e4-39c6d18802c8 req-54ba8992-c931-49f8-be0d-1df213ee6ba6 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:33.025340 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cda698b2-79e6-4786-a3e4-39c6d18802c8 req-54ba8992-c931-49f8-be0d-1df213ee6ba6 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.0888734 May 20 20:34:33.064434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13211a3b-0a90-40cc-b787-a3969e9196f6 req-93d8d29a-a4de-4c1e-9925-8236cbfdc749 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:33.065976 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-13211a3b-0a90-40cc-b787-a3969e9196f6 req-93d8d29a-a4de-4c1e-9925-8236cbfdc749 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.1032555 May 20 20:34:33.090776 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cda698b2-79e6-4786-a3e4-39c6d18802c8 req-6ec6e9e9-8056-477d-b7e0-2d9091da69e8 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596998 May 20 20:34:33.115030 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-13211a3b-0a90-40cc-b787-a3969e9196f6 req-d77913c7-e453-46fc-8ed3-a761a7953946 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418525 May 20 20:34:33.822618 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-b755d3e1-7b54-4dff-af38-9e623de4be8e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:33.824060 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-b755d3e1-7b54-4dff-af38-9e623de4be8e tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.69 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.1686234 May 20 20:34:33.962262 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Deleting port 0d67a0d3-7c10-49ac-89c0-e4f771176280 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:33.962593 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:34.094847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] For port 0d67a0d3-7c10-49ac-89c0-e4f771176280, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=0d67a0d3-7c10-49ac-89c0-e4f771176280,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:34.095554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:34.226058 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Calling delete_port for 0d67a0d3-7c10-49ac-89c0-e4f771176280 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:34.342916 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5423ec5-1c62-49a4-a11c-fdafe7f0bf68 req-56156a1b-9549-4afb-8fb8-a76f42c0fe92 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:34.343498 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb06f82b-b9a7-4e02-a8e1-ad804d548a8a req-99a344a7-8999-476b-9dcb-07f46717ab8d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:34.344447 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d5423ec5-1c62-49a4-a11c-fdafe7f0bf68 req-56156a1b-9549-4afb-8fb8-a76f42c0fe92 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0882587 May 20 20:34:34.348241 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-eb06f82b-b9a7-4e02-a8e1-ad804d548a8a req-99a344a7-8999-476b-9dcb-07f46717ab8d tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 945 time: 0.1291032 May 20 20:34:34.447459 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-eb06f82b-b9a7-4e02-a8e1-ad804d548a8a req-4aea2f64-0fc5-45e5-97fa-dd294403ed5a tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/security-groups?id=a280c5d3-c0db-4e96-8163-d76c7fb84fac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930507 May 20 20:34:34.486846 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d5423ec5-1c62-49a4-a11c-fdafe7f0bf68 req-b5259c8b-4a96-4a30-80c8-55604dd455b8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1299748 May 20 20:34:34.488270 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:34.496435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0ba2f45f-50af-43d2-a3e4-24bc8a360893 tempest-ServerRescueNegativeTestJSON-549339753 tempest-ServerRescueNegativeTestJSON-549339753-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:34.506366 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['0d67a0d3-7c10-49ac-89c0-e4f771176280'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:34:34.548486 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Pushing event deleted for resources: {'Port': ['ID=0d67a0d3-7c10-49ac-89c0-e4f771176280,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:34.550857 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:34.626073 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] No DVR routers for this DVR port 0d67a0d3-7c10-49ac-89c0-e4f771176280 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:34:34.628637 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:34.631330 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'name': 'network-vif-deleted', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:34:34.647016 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d1aa8fcc-31f7-44fc-b8c3-f6791d97bfa1 req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.69 "DELETE /v2.0/ports/0d67a0d3-7c10-49ac-89c0-e4f771176280 HTTP/1.1" status: 204 len: 173 time: 0.8135238 May 20 20:34:34.680042 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac9a78ee-5f51-4505-9868-591c1890d39c', 'name': 'network-vif-deleted', 'tag': '0d67a0d3-7c10-49ac-89c0-e4f771176280', 'status': 'completed', 'code': 200} May 20 20:34:34.764176 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d3f28503-b6b9-4bf4-b4c3-a336388dfc51 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:35.609910 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ddb365e9-ec89-4aea-b9eb-8420aa7a35d6 req-6dbe82fe-dd08-4cea-875a-b0145e90820f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Synchronizing usage tracker for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:34:35.624933 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ddb365e9-ec89-4aea-b9eb-8420aa7a35d6 req-6dbe82fe-dd08-4cea-875a-b0145e90820f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Unset dirty status for tenant:7c0b04802f8b42819b613e195b66efb7 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:34:35.626208 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ddb365e9-ec89-4aea-b9eb-8420aa7a35d6 req-6dbe82fe-dd08-4cea-875a-b0145e90820f tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.0618827 May 20 20:34:35.677338 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0136e28-7ad4-49fa-9872-1af48c08740e req-6d98765b-4e20-444d-a2f5-484a0d3b15a8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:35.678818 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f0136e28-7ad4-49fa-9872-1af48c08740e req-6d98765b-4e20-444d-a2f5-484a0d3b15a8 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0801792 May 20 20:34:35.728313 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f0136e28-7ad4-49fa-9872-1af48c08740e req-7cf3bcb2-597c-4cfa-a2b0-2a5749344b65 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434151 May 20 20:34:36.788896 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1895d648-df8b-479d-ae8c-b1d6fcfee789 req-9ee35f33-28bc-4f93-b304-84e652fbe7a2 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.0422359 May 20 20:34:36.957378 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c87e18d-3bf3-4a5b-89a4-0010941a7a67 req-787d2be6-5ac7-4773-b432-3111516ed9b0 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:36.958827 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c87e18d-3bf3-4a5b-89a4-0010941a7a67 req-787d2be6-5ac7-4773-b432-3111516ed9b0 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0787373 May 20 20:34:37.004295 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c87e18d-3bf3-4a5b-89a4-0010941a7a67 req-b0dc17a1-5d79-467c-b2ea-3dcd78421026 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391920 May 20 20:34:37.211974 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:37.337153 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 0d67a0d3-7c10-49ac-89c0-e4f771176280 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:37.400092 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 0d67a0d3-7c10-49ac-89c0-e4f771176280 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:34:37.400433 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 0d67a0d3-7c10-49ac-89c0-e4f771176280 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:34:37.494079 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5648a04d-ac80-4be6-b9d6-96059c62192f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:37.950760 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3bf4a516-fbb7-4780-9c5a-b19d050d80dc req-52d11540-1ab7-4444-bd3d-5cb0b8c6c8f3 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.0443385 May 20 20:34:38.189901 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7494cc92-9108-4098-a005-c1336f334e35 req-a4f5289f-320d-422d-8e2e-054c296ca69d tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:38.191295 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7494cc92-9108-4098-a005-c1336f334e35 req-a4f5289f-320d-422d-8e2e-054c296ca69d tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0796442 May 20 20:34:38.238692 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7494cc92-9108-4098-a005-c1336f334e35 req-7e012f7f-a44a-4470-8564-d98acdc5b48e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410180 May 20 20:34:38.286485 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:39.118827 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3b6123db-1626-447b-826d-54b8fc9a7b9b req-b5cf47b2-29c0-45ce-a5c1-c0fbcf95e401 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac9a78ee-5f51-4505-9868-591c1890d39c HTTP/1.1" status: 200 len: 210 time: 0.0454941 May 20 20:34:39.428829 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000dd854-2f26-43fc-bddc-067dc3af1cb7 req-09935568-999b-480a-9e79-313b0f7b4609 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:39.430561 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-000dd854-2f26-43fc-bddc-067dc3af1cb7 req-09935568-999b-480a-9e79-313b0f7b4609 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0814543 May 20 20:34:39.477219 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-000dd854-2f26-43fc-bddc-067dc3af1cb7 req-e0a242b6-e7bb-44b5-a409-66c6edb5234c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408986 May 20 20:34:39.903513 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:40.680473 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7b7d8b1-40d6-404e-b4bd-624df4280152 req-dbe157a4-bb4e-421f-83e5-3f620ae95656 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:40.682204 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e7b7d8b1-40d6-404e-b4bd-624df4280152 req-dbe157a4-bb4e-421f-83e5-3f620ae95656 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0911148 May 20 20:34:40.730438 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e7b7d8b1-40d6-404e-b4bd-624df4280152 req-aa88372b-b0dc-4a3f-91aa-b25e0d50776e tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427206 May 20 20:34:40.921117 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43472) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:41.577253 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:41.922626 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc938b1e-894c-4632-b57e-14938b92aa3c req-2d081671-fb45-4eb6-b307-c41455c70a1d tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:41.924126 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bc938b1e-894c-4632-b57e-14938b92aa3c req-2d081671-fb45-4eb6-b307-c41455c70a1d tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0821543 May 20 20:34:41.974831 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bc938b1e-894c-4632-b57e-14938b92aa3c req-0ac357a0-7482-4e8f-9648-e6e53f6c9423 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446339 May 20 20:34:41.988320 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Deleting port 93b0417e-99f4-4721-9a41-9257895317c2 {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:41.988815 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:42.198659 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] For port 93b0417e-99f4-4721-9a41-9257895317c2, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=93b0417e-99f4-4721-9a41-9257895317c2,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:42.199007 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:42.330992 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Calling delete_port for 93b0417e-99f4-4721-9a41-9257895317c2 owned by network:router_interface {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:42.611482 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:42.615663 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:42.658208 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Pushing event deleted for resources: {'Port': ['ID=93b0417e-99f4-4721-9a41-9257895317c2,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:42.687078 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:42.931090 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:42.998442 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8901084c-f60b-4b41-82bc-2d359b04000f details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:34:43.134039 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:43.150193 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '8901084c-f60b-4b41-82bc-2d359b04000f', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'port_id': '8901084c-f60b-4b41-82bc-2d359b04000f', 'mac_address': 'fa:16:3e:a6:bd:52', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 849, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:34:43.168778 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caee8019-20c8-4cea-aaff-9a4a9149bb51 req-a7c1b329-00f6-4007-8159-bcff4fa2d1bc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:43.170337 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-caee8019-20c8-4cea-aaff-9a4a9149bb51 req-a7c1b329-00f6-4007-8159-bcff4fa2d1bc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 943 time: 0.0809894 May 20 20:34:43.208758 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:43.220191 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-caee8019-20c8-4cea-aaff-9a4a9149bb51 req-6e2d9bcc-0ed3-4520-a1a2-dbdebb42015c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426626 May 20 20:34:43.228425 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8901084c-f60b-4b41-82bc-2d359b04000f {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:34:43.245402 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:43.258194 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:43.259908 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:43.303427 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Router 9e724689-d805-445f-92ab-29fb6d9724fc has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:34:43.333501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=7']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:43.337920 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:43.588818 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:34:43.596980 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] Sync routers for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:34:43.607614 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:43.608258 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:43.614438 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] 10.222.0.82 "PUT /v2.0/routers/9e724689-d805-445f-92ab-29fb6d9724fc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6921194 May 20 20:34:43.616940 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43506) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:43.657032 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['8901084c-f60b-4b41-82bc-2d359b04000f'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:34:43.788515 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks [] for router, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:43.869963 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:43.969723 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.052862 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Deleting port 5e4628b0-fac4-4325-b7b1-0bc70616d12e {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:44.053249 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.180054 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] For port 5e4628b0-fac4-4325-b7b1-0bc70616d12e, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=5e4628b0-fac4-4325-b7b1-0bc70616d12e,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:44.180413 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.299958 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21'}], 'enable_snat': True}, 'gw_port_id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:34:42Z', 'revision_number': 5, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port': {'id': '5e4628b0-fac4-4325-b7b1-0bc70616d12e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9d:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:58Z', 'updated_at': '2021-05-20T20:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:44.315112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] Checking router: 9e724689-d805-445f-92ab-29fb6d9724fc for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:34:44.334910 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Calling delete_port for 5e4628b0-fac4-4325-b7b1-0bc70616d12e owned by network:router_gateway {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:44.335450 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] Routers {'9e724689-d805-445f-92ab-29fb6d9724fc'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:44.335811 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9e724689-d805-445f-92ab-29fb6d9724fc'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:44.444527 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3ab20f-7528-4ff4-ab73-e2a20ceaf029 req-9930c83f-3036-4f39-b30e-dcf656202aad tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:44.452442 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0c3ab20f-7528-4ff4-ab73-e2a20ceaf029 req-9930c83f-3036-4f39-b30e-dcf656202aad tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 944 time: 0.1023479 May 20 20:34:44.506390 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0c3ab20f-7528-4ff4-ab73-e2a20ceaf029 req-e5b4c1ea-4044-4ee5-b240-fe3dcc530efc tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529456 May 20 20:34:44.509244 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.513558 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43530) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:44.520932 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fea5ffa4-d40e-467b-b604-dd9a815b56f3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:44.522936 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] Set router 9e724689-d805-445f-92ab-29fb6d9724fc gateway port host: None {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:44.564358 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Pushing event deleted for resources: {'Port': ['ID=5e4628b0-fac4-4325-b7b1-0bc70616d12e,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:44.567332 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:44.629692 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:34:43Z', 'revision_number': 6, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:44.634368 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b61a536-b341-4356-b2df-630aa8d48cd1 None None] The sync data for ids ['9e724689-d805-445f-92ab-29fb6d9724fc'] in dv-cinder-784623-13-iscsi is: [{'id': '9e724689-d805-445f-92ab-29fb6d9724fc', 'name': 'tempest-TestMinimumBasicScenario-169018634-router', 'tenant_id': '7c0b04802f8b42819b613e195b66efb7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:57Z', 'updated_at': '2021-05-20T20:34:43Z', 'revision_number': 6, 'project_id': '7c0b04802f8b42819b613e195b66efb7', 'gw_port_host': None}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:34:44.650482 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.670351 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.677750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:34:44.683200 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Usage tracker for resource:security_group_rule and tenant:9598f448721a487eb73515f910776453 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:34:44.686315 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:34:44.692639 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:34:44.779944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.784369 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.794095 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bab13a40-90e8-4572-a083-d52b89253b61 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:44.832250 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9598f448721a487eb73515f910776453&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3175843 May 20 20:34:44.835975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43538) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:44.847938 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d644f618-ca3b-441f-a0b2-e27e8bd0a9fb,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:44.853545 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.853742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d4a0804f-e1e8-4525-8343-dfc9ec7e81e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:44.856239 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.906334 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.933071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.945517 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.946100 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9e724689-d805-445f-92ab-29fb6d9724fc {{(pid=91645) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:34:44.958589 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.960423 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] 10.222.0.82 "DELETE /v2.0/routers/9e724689-d805-445f-92ab-29fb6d9724fc HTTP/1.1" status: 204 len: 168 time: 1.3418198 May 20 20:34:44.963032 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43542) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:44.990869 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:44.995054 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c091e4ab-7b15-4d0b-9420-1361f9c8e667 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:45.007425 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d644f618-ca3b-441f-a0b2-e27e8bd0a9fb,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:45.015861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:45.016117 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.028071 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d644f618-ca3b-441f-a0b2-e27e8bd0a9fb HTTP/1.1" status: 204 len: 168 time: 0.1830900 May 20 20:34:45.057064 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.161985 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_v2 [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Deleting subnet cb4537c7-816d-4786-a91f-df295ad528b3 {{(pid=91645) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:34:45.165940 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.217334 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3093741'] for subnet, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.338356 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.608843 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3178326', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4127932'] for subnet, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.613666 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:45.652847 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cb4537c7-816d-4786-a91f-df295ad528b3,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:45.655930 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:45.657008 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.663974 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5df716d6-b0e4-4e01-a515-63c7f89ce019 None None] Network 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:34:45.666778 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43566) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:45.667203 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-57ba56cc-68e7-4cf5-9155-8b76430bb2b7 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/cb4537c7-816d-4786-a91f-df295ad528b3 HTTP/1.1" status: 204 len: 168 time: 0.7028935 May 20 20:34:45.920600 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:45.957777 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 5e4628b0-fac4-4325-b7b1-0bc70616d12e no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:45.995107 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 5e4628b0-fac4-4325-b7b1-0bc70616d12e {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:34:45.995107 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 5e4628b0-fac4-4325-b7b1-0bc70616d12e not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:34:45.995107 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 93b0417e-99f4-4721-9a41-9257895317c2 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:46.026868 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f3dede-7dee-4b08-8567-d44963f2f1bd req-47aeb5a4-4863-4c1e-b8ca-a72c2463d711 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:46.028954 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20f3dede-7dee-4b08-8567-d44963f2f1bd req-47aeb5a4-4863-4c1e-b8ca-a72c2463d711 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 944 time: 0.4069521 May 20 20:34:46.036961 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 93b0417e-99f4-4721-9a41-9257895317c2 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:34:46.037390 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 93b0417e-99f4-4721-9a41-9257895317c2 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:34:46.042028 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] DHCP port deletion for 6a4c09f9-50d0-476e-a4d9-6333a5ec1132 request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:34:46.090678 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20f3dede-7dee-4b08-8567-d44963f2f1bd req-f7da5b67-73bc-44ac-a784-d78187037a05 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558722 May 20 20:34:46.092239 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Deleting port 785388a0-6998-435c-84ea-e4eb7f89b000 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:46.092579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.128252 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Deleting port 785388a0-6998-435c-84ea-e4eb7f89b000 {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:46.128766 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.199683 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] For port 785388a0-6998-435c-84ea-e4eb7f89b000, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=785388a0-6998-435c-84ea-e4eb7f89b000,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:46.199987 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.233425 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] For port 785388a0-6998-435c-84ea-e4eb7f89b000, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=785388a0-6998-435c-84ea-e4eb7f89b000,segment=NetworkSegment(7e4d4e68-a93e-461b-b036-66f977f8b866),segment_id=7e4d4e68-a93e-461b-b036-66f977f8b866)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:46.234013 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.329098 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Calling delete_port for 785388a0-6998-435c-84ea-e4eb7f89b000 owned by network:dhcp {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:46.360609 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Calling delete_port for 785388a0-6998-435c-84ea-e4eb7f89b000 owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:46.386398 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.391081 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8147440b-bd11-40b9-829a-96a3b7337830 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:46.445115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Pushing event deleted for resources: {'Port': ['ID=785388a0-6998-435c-84ea-e4eb7f89b000,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:46.448455 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:46.449451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] No DVR routers for this DVR port 785388a0-6998-435c-84ea-e4eb7f89b000 on host dv-cinder-784623-13-iscsi {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:34:46.511100 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.515317 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:46.559446 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Pushing event deleted for resources: {'Port': ['ID=785388a0-6998-435c-84ea-e4eb7f89b000,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:46.563826 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:46.566236 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] No DVR routers for this DVR port 785388a0-6998-435c-84ea-e4eb7f89b000 on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:34:46.578693 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.592428 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6a4c09f9-50d0-476e-a4d9-6333a5ec1132']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:46.604662 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7e4d4e68-a93e-461b-b036-66f977f8b866') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:46.604949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7e4d4e68-a93e-461b-b036-66f977f8b866') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:46.617192 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.634910 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.641309 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Releasing vlan 803 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:34:46.641710 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:34:46.654748 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:34:46.730566 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.735913 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:46.738261 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:46.761103 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Pushing event deleted for resources: {'Network': ['ID=6a4c09f9-50d0-476e-a4d9-6333a5ec1132,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:46.763510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:46.767500 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] 10.222.0.82 "DELETE /v2.0/networks/6a4c09f9-50d0-476e-a4d9-6333a5ec1132 HTTP/1.1" status: 204 len: 168 time: 1.0989084 May 20 20:34:46.770501 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 43582) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:47.003956 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8901084c-f60b-4b41-82bc-2d359b04000f up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:34:47.075050 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 8901084c-f60b-4b41-82bc-2d359b04000f triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:34:47.075446 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:47.196746 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:47.223312 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:34:47.233768 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:47.238817 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:47.242350 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-306b234c-aea7-47fd-8211-ef3184b0fe28 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:47.277989 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f', 'code': 200} May 20 20:34:47.307419 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d499c0cd-75cb-450b-a73c-5b3bd4d1bf11 req-7e2d162a-273d-479f-a979-bdaa2adf509c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:47.309480 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d499c0cd-75cb-450b-a73c-5b3bd4d1bf11 req-7e2d162a-273d-479f-a979-bdaa2adf509c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.1043413 May 20 20:34:47.312679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=8']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:47.315802 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:47.500971 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d499c0cd-75cb-450b-a73c-5b3bd4d1bf11 req-12720791-f244-4589-b024-ceb3ffe40ae3 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1826062 May 20 20:34:47.541352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:47.862535 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-165b5774-9ecd-4d41-bcd7-44b6f73371ae req-2c3c8950-07d1-4791-9648-706891a3dd51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:47.864041 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-165b5774-9ecd-4d41-bcd7-44b6f73371ae req-2c3c8950-07d1-4791-9648-706891a3dd51 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1098 time: 0.2450831 May 20 20:34:47.888180 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 785388a0-6998-435c-84ea-e4eb7f89b000 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:47.930200 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 785388a0-6998-435c-84ea-e4eb7f89b000 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:34:47.930548 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 785388a0-6998-435c-84ea-e4eb7f89b000 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:34:47.930721 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-165b5774-9ecd-4d41-bcd7-44b6f73371ae req-f2852e9e-e79a-4dcb-865b-1706bd35853f service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471873 May 20 20:34:48.061484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Deleting port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:48.061776 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:48.185243 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] For port bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,segment=NetworkSegment(7b4463bd-2158-48b1-8d03-82ca3dc654d2),segment_id=7b4463bd-2158-48b1-8d03-82ca3dc654d2)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:48.185595 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:48.329552 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Calling delete_port for bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c owned by network:router_interface {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:48.485387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:48.489021 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-07222c43-2863-40fd-bbd4-5a7f97edd54a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:48.537320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Pushing event deleted for resources: {'Port': ['ID=bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:48.571945 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:48.859751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dba81e-99b2-417b-9335-dcec9dcfcdc6 req-9b719c36-2fe6-4954-833d-53ace92cd126 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:48.861196 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-38dba81e-99b2-417b-9335-dcec9dcfcdc6 req-9b719c36-2fe6-4954-833d-53ace92cd126 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.2421427 May 20 20:34:48.886601 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:49.075014 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-38dba81e-99b2-417b-9335-dcec9dcfcdc6 req-5e4c0e1c-7034-47ac-8249-14887b02c138 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2058253 May 20 20:34:49.360654 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Router d63065d7-57de-4efa-8b36-85f81f815603 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:34:49.553905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:34:49.566298 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] Sync routers for ids ['d63065d7-57de-4efa-8b36-85f81f815603'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:34:49.568513 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43618) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:49.569728 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] 10.222.0.82 "PUT /v2.0/routers/d63065d7-57de-4efa-8b36-85f81f815603/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7971315 May 20 20:34:49.578657 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] Routers {'d63065d7-57de-4efa-8b36-85f81f815603'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:49.579600 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d63065d7-57de-4efa-8b36-85f81f815603'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:49.759295 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks [] for router, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:49.799403 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] Set router d63065d7-57de-4efa-8b36-85f81f815603 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:49.899012 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:34:49.945268 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.018101 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Deleting port fc5c1c51-e5c6-402f-b1fb-66854c51120e {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:50.018356 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.088349 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:34:48Z', 'revision_number': 5, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port': {'id': 'fc5c1c51-e5c6-402f-b1fb-66854c51120e', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:4f:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'device_owner': 'network:router_gateway', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:29:07Z', 'updated_at': '2021-05-20T20:29:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:50.092245 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] Checking router: d63065d7-57de-4efa-8b36-85f81f815603 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:34:50.101362 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] Routers {'d63065d7-57de-4efa-8b36-85f81f815603'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:34:50.102444 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['d63065d7-57de-4efa-8b36-85f81f815603'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:50.145856 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] For port fc5c1c51-e5c6-402f-b1fb-66854c51120e, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=fc5c1c51-e5c6-402f-b1fb-66854c51120e,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:50.146252 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.262298 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] Set router d63065d7-57de-4efa-8b36-85f81f815603 gateway port host: None {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:34:50.274215 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Calling delete_port for fc5c1c51-e5c6-402f-b1fb-66854c51120e owned by network:router_gateway {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:50.283793 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c360c5ec-53ca-4227-8bde-1ab4caff2df7 req-03113946-b11c-4532-a33f-cca9b4201f0c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:50.285401 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c360c5ec-53ca-4227-8bde-1ab4caff2df7 req-03113946-b11c-4532-a33f-cca9b4201f0c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0928848 May 20 20:34:50.333075 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c360c5ec-53ca-4227-8bde-1ab4caff2df7 req-dec3afdd-8b72-461b-a71d-3e358e38317c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409603 May 20 20:34:50.369655 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:34:49Z', 'revision_number': 6, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:50.373585 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dead2b6-9a20-4422-b018-388c0495af0d None None] The sync data for ids ['d63065d7-57de-4efa-8b36-85f81f815603'] in dv-cinder-784623-13-iscsi is: [{'id': 'd63065d7-57de-4efa-8b36-85f81f815603', 'name': 'tempest-TestMinimumBasicScenario-1616390154-router', 'tenant_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:29:06Z', 'updated_at': '2021-05-20T20:34:49Z', 'revision_number': 6, 'project_id': 'c4e2e503546247aab6ddc6897b8f0a03', 'gw_port_host': None}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:34:50.424947 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.429388 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:50.474123 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Pushing event deleted for resources: {'Port': ['ID=fc5c1c51-e5c6-402f-b1fb-66854c51120e,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:50.477799 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:50.667220 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.848583 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.851537 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.885002 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.885603 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Fanout notify agent at l3_agent the message router_deleted on router d63065d7-57de-4efa-8b36-85f81f815603 {{(pid=91645) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:34:50.898581 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:50.899700 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-1693b3d7-fa32-4788-9b91-e196194820ad admin admin] 10.222.0.82 "DELETE /v2.0/routers/d63065d7-57de-4efa-8b36-85f81f815603 HTTP/1.1" status: 204 len: 168 time: 1.3287442 May 20 20:34:50.902197 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43636) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:50.965616 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_v2 [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Deleting subnet 6678003c-d218-460d-b219-200282a61c74 {{(pid=91645) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:34:50.968585 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.018648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3093741'] for subnet, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.101191 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.356188 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3178326', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4127932'] for subnet, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.361630 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e8432f33-3044-4301-a0ee-0f72bc5755a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:51.404759 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6678003c-d218-460d-b219-200282a61c74,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:51.404759 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:51.406047 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.411705 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/6678003c-d218-460d-b219-200282a61c74 HTTP/1.1" status: 204 len: 168 time: 0.5085013 May 20 20:34:51.415060 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43642) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:51.418725 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afd2b99c-2ef6-4b38-8f84-3caed8ee4553 None None] Network 6821d522-feb4-4c2d-b828-7644a8c51b07 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:34:51.521375 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.601489 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Deleting port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:51.602274 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.686796 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] DHCP port deletion for 6821d522-feb4-4c2d-b828-7644a8c51b07 request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:34:51.707300 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] For port e53897c6-5312-4f90-b7ac-8fc3aa8127e4, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,segment=NetworkSegment(7b4463bd-2158-48b1-8d03-82ca3dc654d2),segment_id=7b4463bd-2158-48b1-8d03-82ca3dc654d2)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:51.707913 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.753676 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Deleting port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:34:51.754055 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.828830 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Calling delete_port for e53897c6-5312-4f90-b7ac-8fc3aa8127e4 owned by network:dhcp {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:51.852234 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] For port e53897c6-5312-4f90-b7ac-8fc3aa8127e4, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,segment=NetworkSegment(7b4463bd-2158-48b1-8d03-82ca3dc654d2),segment_id=7b4463bd-2158-48b1-8d03-82ca3dc654d2)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:34:51.852652 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.877368 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:51.881713 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:51.932729 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Pushing event deleted for resources: {'Port': ['ID=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:51.935737 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:51.938920 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] No DVR routers for this DVR port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 on host dv-cinder-784623-13-iscsi {{(pid=91645) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:34:51.947119 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:52.040046 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Calling delete_port for e53897c6-5312-4f90-b7ac-8fc3aa8127e4 owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:34:52.042335 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:34:52.042936 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bce2d3de-f0b3-44c4-8396-ddf6bc6bdb5c not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:34:52.043351 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e53897c6-5312-4f90-b7ac-8fc3aa8127e4 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:52.083412 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: e53897c6-5312-4f90-b7ac-8fc3aa8127e4 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:34:52.083775 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e53897c6-5312-4f90-b7ac-8fc3aa8127e4 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:34:52.084446 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device fc5c1c51-e5c6-402f-b1fb-66854c51120e no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:34:52.121276 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: fc5c1c51-e5c6-402f-b1fb-66854c51120e {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:34:52.121624 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device fc5c1c51-e5c6-402f-b1fb-66854c51120e not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:34:52.160363 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.164929 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:52.165725 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.180213 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6821d522-feb4-4c2d-b828-7644a8c51b07']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:52.192479 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7b4463bd-2158-48b1-8d03-82ca3dc654d2') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:52.192768 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7b4463bd-2158-48b1-8d03-82ca3dc654d2') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:34:52.209082 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.209182 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Pushing event deleted for resources: {'Port': ['ID=e53897c6-5312-4f90-b7ac-8fc3aa8127e4,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:52.212217 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:52.213005 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] No DVR routers for this DVR port e53897c6-5312-4f90-b7ac-8fc3aa8127e4 on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:34:52.232730 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.239377 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Releasing vlan 817 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:34:52.239864 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:34:52.254078 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:34:52.329866 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.333336 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:52.349458 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.356404 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Pushing event deleted for resources: {'Network': ['ID=6821d522-feb4-4c2d-b828-7644a8c51b07,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:52.360493 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:52.363143 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] 10.222.0.82 "DELETE /v2.0/networks/6821d522-feb4-4c2d-b828-7644a8c51b07 HTTP/1.1" status: 204 len: 168 time: 0.9471679 May 20 20:34:52.560778 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43658) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:52.608725 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f0f3207a-124a-433e-ab72-887e6d15758d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7c0b04802f8b42819b613e195b66efb7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0467126 May 20 20:34:52.611028 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43662) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:52.671779 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5e4bcae9-9662-4da0-b9d3-9db5a311fa17 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.697471 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5e4bcae9-9662-4da0-b9d3-9db5a311fa17 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.748926 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5e4bcae9-9662-4da0-b9d3-9db5a311fa17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.753802 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-03eda6a2-7aa4-485f-9e86-ad415dcc5ec5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:52.770962 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e4bcae9-9662-4da0-b9d3-9db5a311fa17 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a280c5d3-c0db-4e96-8163-d76c7fb84fac,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:52.774594 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5e4bcae9-9662-4da0-b9d3-9db5a311fa17 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:52.784217 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5e4bcae9-9662-4da0-b9d3-9db5a311fa17 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:52.787650 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-5e4bcae9-9662-4da0-b9d3-9db5a311fa17 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a280c5d3-c0db-4e96-8163-d76c7fb84fac HTTP/1.1" status: 204 len: 168 time: 0.1734395 May 20 20:34:53.133871 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43672) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:53.181954 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e4be3c5c-cbfe-4c1a-bd0c-b57aab215b08 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c4e2e503546247aab6ddc6897b8f0a03&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0467000 May 20 20:34:53.184149 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43676) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:34:53.243068 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:53.268049 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:53.319892 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:53.323907 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-12394fe2-9457-4d0d-b96a-79044d1602eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:34:53.335728 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92073739-adb9-4180-aa11-45e7cb9a2dec,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:34:53.338512 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:34:53.344361 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:34:53.345490 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/92073739-adb9-4180-aa11-45e7cb9a2dec HTTP/1.1" status: 204 len: 168 time: 0.1604528 May 20 20:34:58.511308 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170fe104-c323-4904-a176-caca45528c9a req-52e3eb17-fea2-4959-9c55-f7b6e7eb0c5f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:58.512903 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-170fe104-c323-4904-a176-caca45528c9a req-52e3eb17-fea2-4959-9c55-f7b6e7eb0c5f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0868099 May 20 20:34:58.558535 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-170fe104-c323-4904-a176-caca45528c9a req-900e90b5-5259-4a36-baff-bcf548c4b64e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399077 May 20 20:34:59.745542 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8939521e-b5a2-452f-9fef-13fb39138510 req-eecf6681-29e7-42b1-b915-41eba84c7495 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:34:59.746979 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8939521e-b5a2-452f-9fef-13fb39138510 req-eecf6681-29e7-42b1-b915-41eba84c7495 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0791991 May 20 20:34:59.794634 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8939521e-b5a2-452f-9fef-13fb39138510 req-e9436a41-2a45-4dda-b23c-7b5911973ea2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416095 May 20 20:35:00.990166 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a85f8f-7264-4033-9365-69418f31e409 req-d948af59-c22b-4af9-b873-cf558ab732df tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:00.991869 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a85f8f-7264-4033-9365-69418f31e409 req-d948af59-c22b-4af9-b873-cf558ab732df tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0873899 May 20 20:35:01.037715 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a85f8f-7264-4033-9365-69418f31e409 req-42ae58b7-79bf-4efe-9d47-f8bacd5084ed tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=68f68b1b-776a-426b-aa7f-53510f02ba9d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399330 May 20 20:35:01.281692 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-95e58a19-a441-44cf-86f0-d6c35991f315 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:01.283091 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-95e58a19-a441-44cf-86f0-d6c35991f315 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 946 time: 0.0866055 May 20 20:35:01.431988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Deleting port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:35:01.432287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:01.569903 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] For port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:01.570172 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:01.942633 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:01.942971 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:01.943286 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Floating IP 8ecd567a-2a1f-4d10-88fd-79413207b227 disassociated. External IP: 172.27.3.95, port: 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c. May 20 20:35:01.943637 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Calling delete_port for 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:35:02.051469 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:02.057418 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ff34c1ff-e910-4014-b0f5-58af63d2eeee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:02.100497 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event deleted for resources: {'Port': ['ID=44f2b7d5-3bf8-4810-b1cf-0c839fe1827c,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:02.104091 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:02.214144 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-31d29776-9abf-4bbf-838f-4daaf3d551ad req-917ea1f5-071a-48e8-9dba-d09235bf9eb5 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.0587068 May 20 20:35:02.325125 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:35:02.510443 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:35:02.523821 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] Sync routers for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:35:02.542061 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:35:02.543008 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:02.595670 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] No DVR routers for this DVR port 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:35:02.597267 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:02.600397 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'name': 'network-vif-deleted', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:35:02.622061 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7ba657a7-ed99-411b-a0d6-c0dec00a2deb req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "DELETE /v2.0/ports/44f2b7d5-3bf8-4810-b1cf-0c839fe1827c HTTP/1.1" status: 204 len: 173 time: 1.3280959 May 20 20:35:02.666269 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b88d13f8-1cbb-48aa-82c4-614e5df9a3be', 'name': 'network-vif-deleted', 'tag': '44f2b7d5-3bf8-4810-b1cf-0c839fe1827c', 'status': 'completed', 'code': 200} May 20 20:35:02.734246 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:35:03.047337 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:03.051019 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] Checking router: e666c92f-d3d0-46f1-aeb9-c3dd182bf186 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:35:03.060004 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:35:03.060632 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:34:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:03.237823 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:35:03.407081 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cdba609c-6858-4ab9-aa74-237e70bc1416 req-e47c8a7d-1495-4569-8025-6c5e96139000 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=b88d13f8-1cbb-48aa-82c4-614e5df9a3be HTTP/1.1" status: 200 len: 210 time: 0.0510678 May 20 20:35:03.594167 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:03.598119 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d9627b6-613a-40ef-b9b3-e51a5d792238 None None] The sync data for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi is: [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:35:03.806990 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddbe1391-ac0a-4118-ba4c-79f11560ef48 None None] New status for floating IP 8ecd567a-2a1f-4d10-88fd-79413207b227: DOWN {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:35:04.530965 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43766) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:04.596361 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:04.624349 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:04.677595 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:04.683309 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-4c93ccf4-948e-4c3f-b375-cde7d9ec8ded admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:04.698411 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=68f68b1b-776a-426b-aa7f-53510f02ba9d,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:04.701339 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:04.708714 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:04.709936 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "DELETE /v2.0/security-groups/68f68b1b-776a-426b-aa7f-53510f02ba9d HTTP/1.1" status: 204 len: 168 time: 0.1778417 May 20 20:35:04.712903 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43770) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:04.730952 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.api.v2.resource [None req-8abd4c84-fc36-4d70-9001-c83c5f9a0506 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] show failed (client error): The resource could not be found. May 20 20:35:04.732050 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8abd4c84-fc36-4d70-9001-c83c5f9a0506 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups/68f68b1b-776a-426b-aa7f-53510f02ba9d HTTP/1.1" status: 404 len: 347 time: 0.0181320 May 20 20:35:04.734771 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43774) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:04.766843 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-be04d499-7ace-4981-b114-ef84224f8e04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:04.952737 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Deleting port 0f641d27-b4f0-4fb1-a358-3b2af089c17f {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:35:04.953069 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.070505 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.070731 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.125581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:35:05.160641 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:35:05.160995 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 44f2b7d5-3bf8-4810-b1cf-0c839fe1827c not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:35:05.194448 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Calling delete_port for 0f641d27-b4f0-4fb1-a358-3b2af089c17f owned by network:floatingip {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:35:05.312173 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.315834 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8ce59149-afe7-42b8-a8ae-07a87a2598d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:05.359344 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event deleted for resources: {'Port': ['ID=0f641d27-b4f0-4fb1-a358-3b2af089c17f,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:05.362483 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:05.455129 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.469354 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.472333 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "DELETE /v2.0/floatingips/8ecd567a-2a1f-4d10-88fd-79413207b227 HTTP/1.1" status: 204 len: 168 time: 0.7365997 May 20 20:35:05.763050 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43826) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:05.768775 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1154989954', 'description': 'tempest-description--1128835424'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:35:05.776933 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:35:05.781350 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:35:05.784754 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:35:05.791009 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:35:05.802386 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.825113 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:35:05.830858 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group_rule and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:35:05.834965 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:35:05.841113 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:35:05.912041 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.915562 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.919268 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ce62d5d4-40bd-484e-b744-88f73f757a64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:05.963814 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6f877e06-701c-43c3-98f7-91a4026f2219,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:05.966560 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:05.967789 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.2035086 May 20 20:35:05.968644 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:05.970844 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43830) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:05.975800 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'security_group_rule': {'security_group_id': '6f877e06-701c-43c3-98f7-91a4026f2219', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:35:05.981477 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:35:05.985397 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group_rule and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:35:05.988215 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:35:05.994615 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:35:06.011063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.073224 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.076847 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.078813 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:06.101161 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=07966573-6c95-4218-919e-61dcc9f94990,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:06.106126 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:06.112808 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.117410 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1423757 May 20 20:35:06.117958 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43840) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:06.123240 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'security_group_rule': {'security_group_id': '6f877e06-701c-43c3-98f7-91a4026f2219', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:35:06.129284 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:35:06.134172 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:security_group_rule and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:35:06.137255 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:35:06.144070 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:35:06.160946 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.228660 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.232867 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.234945 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:06.258372 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6022eda2-299d-4109-b9c9-2a6b118703d7,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:06.263056 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:06.267540 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.268959 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-13c492f8-ca22-46e3-b692-078017f332a3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1503320 May 20 20:35:06.272560 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43852) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:06.277828 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:35:06.283431 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:35:06.287941 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Usage tracker for resource:floatingip and tenant:831701ab26e241d0ac004d15e3ea0632 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:35:06.291168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:35:06.297650 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:35:06.310832 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.456844 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.597862 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Allocated IP 172.27.3.209 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/2bc1f9fb-96f9-4a5f-827b-8cae8aa8a03f) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:35:06.844381 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.874015 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:06.878779 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-93b5cec3-24be-41f8-afef-5884707eb937 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:06.947134 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:35:06.949896 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:35:06.953536 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:35:06.986670 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'Port': ['ID=2bc1f9fb-96f9-4a5f-827b-8cae8aa8a03f,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:06.991987 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:07.038595 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.101636 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.218514 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.321114 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.326600 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3178412'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.330403 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ce784deb-1e70-40f0-9bf6-10508fa6b9f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:07.440631 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'Port': ['ID=2bc1f9fb-96f9-4a5f-827b-8cae8aa8a03f,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:07.446055 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:07.452947 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.475643 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.476863 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-d8db5fa6-9ce0-4144-be21-90bbbc0131b2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2033961 May 20 20:35:07.502398 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9936165e-4da5-4059-a412-6101aed79c82 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:07.701069 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-7353092f-bfee-468e-816d-d2ae1167d72a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:35:07.716613 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-7353092f-bfee-468e-816d-d2ae1167d72a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:35:07.717948 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-7353092f-bfee-468e-816d-d2ae1167d72a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1154989954&fields=id&tenant_id=831701ab26e241d0ac004d15e3ea0632 HTTP/1.1" status: 200 len: 267 time: 0.0575349 May 20 20:35:07.868236 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-4b379cf4-d0be-4332-9ba7-434b22c8ecf3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:07.869639 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-4b379cf4-d0be-4332-9ba7-434b22c8ecf3 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 810 time: 0.1451404 May 20 20:35:07.885243 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-aa2d6295-03f6-4893-913f-d75242938a65 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/quotas/831701ab26e241d0ac004d15e3ea0632 HTTP/1.1" status: 200 len: 375 time: 0.0100245 May 20 20:35:07.971066 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-a10953ef-673e-4ae7-9edc-22ef9d96e052 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:35:07.986741 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-a10953ef-673e-4ae7-9edc-22ef9d96e052 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:35:07.988125 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-a10953ef-673e-4ae7-9edc-22ef9d96e052 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0981708 May 20 20:35:08.127138 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-a661ca58-c2c9-44f7-9d3a-ad93ee472db1 service neutron] 10.222.0.82 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269407 May 20 20:35:08.265178 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-aaec0f56-f6cc-4e76-9d6b-a26660f961d0 service neutron] 10.222.0.82 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1306927 May 20 20:35:08.289746 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:08.446607 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-603eaf95-aadd-4c8c-8c2c-cb376f511ccf req-d414f587-b20b-4709-8797-b112a74d90cb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:35:08.459322 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-603eaf95-aadd-4c8c-8c2c-cb376f511ccf req-d414f587-b20b-4709-8797-b112a74d90cb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:35:08.460617 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-603eaf95-aadd-4c8c-8c2c-cb376f511ccf req-d414f587-b20b-4709-8797-b112a74d90cb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 210 time: 0.0610316 May 20 20:35:09.625529 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-461c6094-bcd7-406c-b81b-8089794017df req-3d59f426-4d18-4a4e-8a40-81422981fdf1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 210 time: 0.0492814 May 20 20:35:09.825366 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-37de1e12-c690-4acc-8ce1-cac309cf3a17 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:09.826751 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-37de1e12-c690-4acc-8ce1-cac309cf3a17 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 810 time: 0.1480365 May 20 20:35:09.882128 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-55d04d7e-c4f7-4b2a-8059-1ec61cd51dad tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=831701ab26e241d0ac004d15e3ea0632 HTTP/1.1" status: 200 len: 380 time: 0.0413361 May 20 20:35:09.908083 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:09.922514 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'port': {'device_id': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'admin_state_up': True, 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'security_groups': ['6f877e06-701c-43c3-98f7-91a4026f2219']}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:35:10.057940 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:35:10.067778 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:35:10.079150 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Made reservation on behalf of 831701ab26e241d0ac004d15e3ea0632 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:35:10.082864 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:10.252091 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Allocated IP 172.20.0.3 (16b76e5b-322b-4d3c-b8d3-2d6888efd464/0f0b1ce3-e7c0-4e40-a18c-07e082124ea7/2abde94a-966c-4288-b8cb-201a164e69b0) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:35:10.533123 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:10.549804 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Transition to ACTIVE for port object 2abde94a-966c-4288-b8cb-201a164e69b0 will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:35:10.573384 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:10.578801 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ebe76ef5-4d67-4365-898f-627c6541ce49 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:10.647842 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:35:10.651050 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:35:10.655091 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:35:10.685559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event updated for resources: {'Port': ['ID=2abde94a-966c-4288-b8cb-201a164e69b0,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:10.700113 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.700482 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.700836 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.701179 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.701523 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.701874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.702212 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.702553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.702904 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.703244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.703579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.703940 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:10.713379 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:10.753434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:10.754068 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:10.834426 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9157937 May 20 20:35:10.856681 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Request body: {'port': {'device_id': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:35:10.896118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db1f787-44a1-457c-84e6-b15d35414f54 req-caa25cc5-239e-402d-9ae1-d329c7f05c6e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:10.896118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-1db1f787-44a1-457c-84e6-b15d35414f54 req-caa25cc5-239e-402d-9ae1-d329c7f05c6e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Synchronizing usage tracker for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:35:10.911598 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-eb0096e8-ea87-46db-9a9f-5735d49bad76 None None] Provisioning for port 2abde94a-966c-4288-b8cb-201a164e69b0 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:35:10.919306 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-eb0096e8-ea87-46db-9a9f-5735d49bad76 None None] Provisioning complete for port 2abde94a-966c-4288-b8cb-201a164e69b0 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:35:10.919719 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-eb0096e8-ea87-46db-9a9f-5735d49bad76 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:10.976072 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-1db1f787-44a1-457c-84e6-b15d35414f54 req-caa25cc5-239e-402d-9ae1-d329c7f05c6e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Unset dirty status for tenant:831701ab26e241d0ac004d15e3ea0632 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:35:10.977276 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1db1f787-44a1-457c-84e6-b15d35414f54 req-caa25cc5-239e-402d-9ae1-d329c7f05c6e tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 931 time: 0.2307754 May 20 20:35:10.981311 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-eb0096e8-ea87-46db-9a9f-5735d49bad76 None None] Port 2abde94a-966c-4288-b8cb-201a164e69b0 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:35:11.015160 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:11.078303 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1db1f787-44a1-457c-84e6-b15d35414f54 req-5d771189-6f1e-4603-9709-bd35c5b3cdaf tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0908597 May 20 20:35:11.417457 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2abde94a-966c-4288-b8cb-201a164e69b0 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:35:11.424899 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:11.439905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Transition to ACTIVE for port object 2abde94a-966c-4288-b8cb-201a164e69b0 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:35:11.444330 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:11.447983 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-65902697-92a3-4c50-9b82-cc72fe850459 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:11.576701 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Pushing event updated for resources: {'Port': ['ID=2abde94a-966c-4288-b8cb-201a164e69b0,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:11.606253 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:11.686367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Attempting to bind port 2abde94a-966c-4288-b8cb-201a164e69b0 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:35:11.687035 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Attempting to bind port 2abde94a-966c-4288-b8cb-201a164e69b0 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:35:11.687035 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Attempting to bind port 2abde94a-966c-4288-b8cb-201a164e69b0 on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:35:11.691590 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Port 2abde94a-966c-4288-b8cb-201a164e69b0 on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:35:11.691938 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Attempting to bind port 2abde94a-966c-4288-b8cb-201a164e69b0 on network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:35:11.697862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 34, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:35:11.698195 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Checking segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:35:11.698576 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Bound using segment: {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:35:11.699000 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Bound port: 2abde94a-966c-4288-b8cb-201a164e69b0, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1427bab-94d8-4746-a3e3-cb687a069788', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 843, 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:35:11.699336 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:11.797396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] For port 2abde94a-966c-4288-b8cb-201a164e69b0, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:35:11.800923 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] For port 2abde94a-966c-4288-b8cb-201a164e69b0, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=2abde94a-966c-4288-b8cb-201a164e69b0,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:35:11.806082 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:11.811043 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:11.858810 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:11.859403 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:11.860785 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] 10.222.0.69 "PUT /v2.0/ports/2abde94a-966c-4288-b8cb-201a164e69b0 HTTP/1.1" status: 200 len: 1093 time: 1.0091472 May 20 20:35:11.870933 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:35:11.898714 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Pushing event updated for resources: {'Port': ['ID=2abde94a-966c-4288-b8cb-201a164e69b0,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:11.902779 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:11.963190 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0', 'status': 'completed', 'code': 200} May 20 20:35:12.001692 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-8b4578c3-b06a-47d1-aafa-308377faf26f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:12.003204 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-8b4578c3-b06a-47d1-aafa-308377faf26f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 1096 time: 0.0789080 May 20 20:35:12.093302 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-5d89a3a7-c2fa-47da-8aa4-06d2f3821822 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2abde94a-966c-4288-b8cb-201a164e69b0 HTTP/1.1" status: 200 len: 217 time: 0.0672071 May 20 20:35:12.173764 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-d6c0d5aa-a3a4-4dab-bff6-7f8417c17a3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:12.175224 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-d6c0d5aa-a3a4-4dab-bff6-7f8417c17a3e service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.0616069 May 20 20:35:12.321824 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59fe661-b2df-4148-8313-3380ea167ad7 req-090ed788-ae36-4934-822a-1cc7d27cc1bb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:12.323255 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b59fe661-b2df-4148-8313-3380ea167ad7 req-090ed788-ae36-4934-822a-1cc7d27cc1bb tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 943 time: 0.1382689 May 20 20:35:12.325712 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-5afd8574-7d05-47bd-ae10-a984fd30a3bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:12.327075 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-5afd8574-7d05-47bd-ae10-a984fd30a3bd service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1402791 May 20 20:35:12.550933 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b59fe661-b2df-4148-8313-3380ea167ad7 req-3b6a7a52-aea2-4c3d-bf11-5e1d47c12043 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2218761 May 20 20:35:12.598211 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-03469379-56bd-4655-8230-87c469932be9 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2564592 May 20 20:35:12.747898 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-68e87622-324f-4a45-bda6-29ae1fd0271f req-074614d4-9c3a-489d-a534-d7e6c2bcbc68 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1322992 May 20 20:35:12.904027 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-5758e990-daaf-4db4-8212-fb1a9a172d72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:12.906832 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-5758e990-daaf-4db4-8212-fb1a9a172d72 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 1096 time: 0.0851543 May 20 20:35:13.083187 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-10586d95-1955-4ac9-8941-7a9ac5cb1b64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:13.085410 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-10586d95-1955-4ac9-8941-7a9ac5cb1b64 service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.1591730 May 20 20:35:13.169786 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-4c810ca6-b730-476c-ab48-73505283764b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2abde94a-966c-4288-b8cb-201a164e69b0 HTTP/1.1" status: 200 len: 217 time: 0.0724251 May 20 20:35:13.244811 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-54e641dd-03e1-48ce-bffc-a937d499d6ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:13.246638 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-54e641dd-03e1-48ce-bffc-a937d499d6ca service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.0659528 May 20 20:35:13.344259 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-3e9ad7d5-5a30-45cb-9f49-692d9401408f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:13.345874 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-3e9ad7d5-5a30-45cb-9f49-692d9401408f service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0744584 May 20 20:35:13.594990 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-cad30ace-3d52-4483-af12-5518d9d9f18a service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2323704 May 20 20:35:13.613046 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-5d02b20d-629d-478a-9247-c529f163b3ac service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1406155 May 20 20:35:13.752232 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74608e9-6073-4dff-806b-5a70efc68663 req-dffdf632-3f7c-4a3a-9933-ed67dc3af70f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:13.753804 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c74608e9-6073-4dff-806b-5a70efc68663 req-dffdf632-3f7c-4a3a-9933-ed67dc3af70f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 943 time: 0.0886815 May 20 20:35:13.810824 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5746cdea-e219-48d5-b9a2-6cc87b6a35d3 req-5c0869a4-6eda-4d37-8d10-1fa2c5098952 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1842561 May 20 20:35:13.812713 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c74608e9-6073-4dff-806b-5a70efc68663 req-c0f03571-8662-43f5-af24-1e5bd8923af1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0526509 May 20 20:35:13.819809 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-225e2b5f-0f9e-4982-ae3b-9159773fdc83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:13.820942 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-225e2b5f-0f9e-4982-ae3b-9159773fdc83 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1098 time: 0.1621408 May 20 20:35:14.001993 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-bd38c3df-170f-4289-9a21-5f96829ecc79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:14.003516 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-bd38c3df-170f-4289-9a21-5f96829ecc79 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 909 time: 0.1330245 May 20 20:35:14.112563 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-7f1d6fc5-9cdb-47ac-ad1b-6ca6d37ccde7 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 1001 time: 0.0953484 May 20 20:35:14.188473 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-458d891e-2f04-4454-b034-47451725b1de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:14.189937 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-458d891e-2f04-4454-b034-47451725b1de service neutron] 10.222.0.69 "GET /v2.0/subnets?id=845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 200 len: 847 time: 0.0640142 May 20 20:35:14.280823 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-0b3675fa-31ac-4029-b0a0-5a114ca77226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:14.282212 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-0b3675fa-31ac-4029-b0a0-5a114ca77226 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9c4884cd-a197-48ab-a497-3c07afe55035&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0818696 May 20 20:35:14.384939 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1056d5e9-7e5d-4cf8-ba97-6df65040e6e8 req-9426008a-dcb6-4c6e-8abb-15dc28cf8b34 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:14.386498 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1056d5e9-7e5d-4cf8-ba97-6df65040e6e8 req-9426008a-dcb6-4c6e-8abb-15dc28cf8b34 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0864298 May 20 20:35:14.435578 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1056d5e9-7e5d-4cf8-ba97-6df65040e6e8 req-2f0c67c4-ff4d-4717-9f40-2b9a02a6769f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426252 May 20 20:35:14.511150 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-5234cbaa-9bb5-487e-a981-82fd590bb168 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2175374 May 20 20:35:14.655421 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e9189ad-799a-4b0d-999f-bf99acaffa6e req-ff5c1eb5-191d-41bd-8718-8160c0318abb service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1267080 May 20 20:35:15.027031 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb2e43c-b75d-46b9-9af6-a2e29bbd809a req-ee819b07-ee42-4606-af61-3f3d7dfb49dc tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:15.029740 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7fb2e43c-b75d-46b9-9af6-a2e29bbd809a req-ee819b07-ee42-4606-af61-3f3d7dfb49dc tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 943 time: 0.0867941 May 20 20:35:15.050117 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:15.078755 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7fb2e43c-b75d-46b9-9af6-a2e29bbd809a req-ab7a4473-e2c1-432c-8e4a-d3d5fcff5cbd tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418696 May 20 20:35:15.174719 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 2abde94a-966c-4288-b8cb-201a164e69b0 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:35:15.314319 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 2abde94a-966c-4288-b8cb-201a164e69b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=2abde94a-966c-4288-b8cb-201a164e69b0,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:15.329253 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '2abde94a-966c-4288-b8cb-201a164e69b0', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'port_id': '2abde94a-966c-4288-b8cb-201a164e69b0', 'mac_address': 'fa:16:3e:40:8a:87', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 843, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:35:15.389810 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:15.406836 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2abde94a-966c-4288-b8cb-201a164e69b0 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:35:15.423673 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 2abde94a-966c-4288-b8cb-201a164e69b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=2abde94a-966c-4288-b8cb-201a164e69b0,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:15.428983 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:15.431127 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:15.498075 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=2abde94a-966c-4288-b8cb-201a164e69b0,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:15.505196 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.505538 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.505906 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.506399 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.506721 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.507043 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.507360 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.507674 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.508020 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.508332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.508646 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.508954 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:15.512787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:15.629644 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4fd0bd-71b4-4265-a9b0-6344588ff232 req-ed289366-94a8-4b57-a76a-e34d9dc64828 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:15.630979 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8d4fd0bd-71b4-4265-a9b0-6344588ff232 req-ed289366-94a8-4b57-a76a-e34d9dc64828 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0775933 May 20 20:35:15.678103 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8d4fd0bd-71b4-4265-a9b0-6344588ff232 req-037cc5de-0a5c-4415-94da-de956200b32a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411525 May 20 20:35:15.864785 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['2abde94a-966c-4288-b8cb-201a164e69b0'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:35:16.262361 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e420f79-1c49-4821-b93c-3e59318d0688 req-3ab60723-1892-41ab-af1f-5070a11f29a6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:16.263825 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5e420f79-1c49-4821-b93c-3e59318d0688 req-3ab60723-1892-41ab-af1f-5070a11f29a6 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 944 time: 0.0789328 May 20 20:35:16.313694 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5e420f79-1c49-4821-b93c-3e59318d0688 req-059887eb-e658-40eb-b47a-08bee72b9fa0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437171 May 20 20:35:16.874569 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-625c8c64-c1c7-4912-aebb-5ab5fb43c588 req-4e08a036-d155-4a1a-a567-b594134c5968 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:16.876043 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-625c8c64-c1c7-4912-aebb-5ab5fb43c588 req-4e08a036-d155-4a1a-a567-b594134c5968 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0851142 May 20 20:35:16.920349 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-625c8c64-c1c7-4912-aebb-5ab5fb43c588 req-3608f621-8b47-4869-a471-b2b8d808da1a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385416 May 20 20:35:17.192970 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 2abde94a-966c-4288-b8cb-201a164e69b0 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:35:17.260761 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 2abde94a-966c-4288-b8cb-201a164e69b0 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:35:17.265199 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 2abde94a-966c-4288-b8cb-201a164e69b0 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:35:17.265575 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:17.384163 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:17.411022 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:35:17.422150 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 2abde94a-966c-4288-b8cb-201a164e69b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=2abde94a-966c-4288-b8cb-201a164e69b0,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:17.426569 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:17.428967 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-dc924bcc-3152-410a-b92c-cc9bbc228554 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:17.465207 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0', 'code': 200} May 20 20:35:17.500427 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=2abde94a-966c-4288-b8cb-201a164e69b0,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:17.503192 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:17.514066 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffe6b8d-2bb9-47a2-9c6a-865e6b6106ac req-8915c2b0-4e23-42c7-aab7-2575a0ffe234 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:17.515532 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1ffe6b8d-2bb9-47a2-9c6a-865e6b6106ac req-8915c2b0-4e23-42c7-aab7-2575a0ffe234 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0938349 May 20 20:35:17.564360 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1ffe6b8d-2bb9-47a2-9c6a-865e6b6106ac req-dd3c40cc-c239-4113-8f0f-bd4a088a0d2a tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428121 May 20 20:35:17.720562 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db7b21b9-bc45-4cbd-89f8-fce1a35e0756 req-6191a3da-5db3-4a4a-8c06-58142de970f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:17.721916 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-db7b21b9-bc45-4cbd-89f8-fce1a35e0756 req-6191a3da-5db3-4a4a-8c06-58142de970f5 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 1098 time: 0.0743773 May 20 20:35:17.767747 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-db7b21b9-bc45-4cbd-89f8-fce1a35e0756 req-9be895fe-eff7-4fb2-806e-9fe9964050cd service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0344558 May 20 20:35:18.111667 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e48f9ec-1a73-4fd6-b6d3-812f7354eb9f req-a01b86c6-df38-4304-8fc3-06d0dbfeacbd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:18.113069 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8e48f9ec-1a73-4fd6-b6d3-812f7354eb9f req-a01b86c6-df38-4304-8fc3-06d0dbfeacbd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0804052 May 20 20:35:18.161835 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8e48f9ec-1a73-4fd6-b6d3-812f7354eb9f req-46a30c15-c5b7-4cc9-bee7-bc7249c98f05 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423672 May 20 20:35:18.753993 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272774ed-71f4-4504-ad65-a051ff25a272 req-4f38d302-8c85-4e20-8dec-96ef75587606 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:18.755440 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-272774ed-71f4-4504-ad65-a051ff25a272 req-4f38d302-8c85-4e20-8dec-96ef75587606 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0801291 May 20 20:35:18.800453 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-272774ed-71f4-4504-ad65-a051ff25a272 req-525bc0f4-8317-4948-8dc6-d5bb51a5aab8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392456 May 20 20:35:19.453523 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d397fcea-6649-4fc9-bc25-487120477c7b req-d3f6a516-f2fd-4200-a718-77b97788faa8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:19.455042 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d397fcea-6649-4fc9-bc25-487120477c7b req-d3f6a516-f2fd-4200-a718-77b97788faa8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.1778164 May 20 20:35:19.500620 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d397fcea-6649-4fc9-bc25-487120477c7b req-3752c869-636f-435c-8bdd-7755c830bc0b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393331 May 20 20:35:19.990176 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a838c29c-244a-416f-bfe1-33c6d6b5b719 req-d81741b6-e6ee-44a2-88a7-6139e7d81366 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:19.991783 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a838c29c-244a-416f-bfe1-33c6d6b5b719 req-d81741b6-e6ee-44a2-88a7-6139e7d81366 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0847168 May 20 20:35:20.036674 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a838c29c-244a-416f-bfe1-33c6d6b5b719 req-6a480313-adc3-437c-8b7d-4813350c16c0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391622 May 20 20:35:20.223316 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bc9729-2fec-4790-b64c-5470b15492f9 req-5f2cbaa4-2f10-47a4-bd74-52273e56017d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:20.224862 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c3bc9729-2fec-4790-b64c-5470b15492f9 req-5f2cbaa4-2f10-47a4-bd74-52273e56017d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0834394 May 20 20:35:20.233348 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 43982) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:20.238457 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Request body: {'floatingip': {'port_id': '2abde94a-966c-4288-b8cb-201a164e69b0'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:35:20.318376 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:20.691049 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ac171b-d6ce-4102-97a1-edfffff2a772 req-e10997e5-8942-4839-951f-74dd4a0a759f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:20.692578 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a5ac171b-d6ce-4102-97a1-edfffff2a772 req-e10997e5-8942-4839-951f-74dd4a0a759f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0820210 May 20 20:35:20.744202 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a5ac171b-d6ce-4102-97a1-edfffff2a772 req-81b88a04-5b52-4df7-a308-657b7826ba74 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450420 May 20 20:35:20.928968 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:20.933664 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:21.100357 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.l3_db [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Floating IP a4805426-4e85-42a9-b3aa-15dad628ae73 associated. External IP: 172.27.3.209, port: 2abde94a-966c-4288-b8cb-201a164e69b0. May 20 20:35:21.556033 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:35:21.737027 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:35:21.742054 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:21.746532 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] Sync routers for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:35:21.757198 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:35:21.757848 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:35:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:21.805791 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c47eef3f-124c-46ad-9a84-167c6ba3a002 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "PUT /v2.0/floatingips/a4805426-4e85-42a9-b3aa-15dad628ae73 HTTP/1.1" status: 200 len: 991 time: 1.5685906 May 20 20:35:21.805791 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:35:21.939101 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:35:21.948689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a1e59c6-c4db-4705-8f1f-85b33f77b200 req-33531aed-a939-4ce0-91da-2d1712f356fd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:21.950175 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2a1e59c6-c4db-4705-8f1f-85b33f77b200 req-33531aed-a939-4ce0-91da-2d1712f356fd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0834894 May 20 20:35:22.000664 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2a1e59c6-c4db-4705-8f1f-85b33f77b200 req-62853aa8-2b03-4956-9c1c-361110f70a25 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438621 May 20 20:35:22.002289 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0', 'status': 'completed', 'code': 200} May 20 20:35:22.125628 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-b9472866-2586-43cc-969f-3b9b2a171343 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:22.127101 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-b9472866-2586-43cc-969f-3b9b2a171343 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=831701ab26e241d0ac004d15e3ea0632&device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 1098 time: 0.0725210 May 20 20:35:22.272087 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-3fea2529-d8b7-403d-955a-1064cfc62f14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:22.273645 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-3fea2529-d8b7-403d-955a-1064cfc62f14 service neutron] 10.222.0.69 "GET /v2.0/networks?id=16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 200 len: 911 time: 0.1342514 May 20 20:35:22.298096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'a4805426-4e85-42a9-b3aa-15dad628ae73', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'port_id': '2abde94a-966c-4288-b8cb-201a164e69b0', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'mac_address': 'fa:16:3e:40:8a:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:35:07Z', 'updated_at': '2021-05-20T20:35:20Z', 'revision_number': 1, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:22.302060 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] Checking router: e666c92f-d3d0-46f1-aeb9-c3dd182bf186 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:35:22.311402 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:35:22.312040 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:35:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:22.388218 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-6e08ffee-e61b-4440-b37d-ea5aa85cd63d service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2abde94a-966c-4288-b8cb-201a164e69b0 HTTP/1.1" status: 200 len: 999 time: 0.1032343 May 20 20:35:22.456253 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-85572bb9-f01e-4b5e-9aca-fe554732dfe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:22.457676 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-85572bb9-f01e-4b5e-9aca-fe554732dfe3 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 200 len: 849 time: 0.0623043 May 20 20:35:22.529196 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:35:22.555394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-e8863de7-9fd2-4b60-8632-6a74aea4584a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:22.556671 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-e8863de7-9fd2-4b60-8632-6a74aea4584a service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=16b76e5b-322b-4d3c-b8d3-2d6888efd464&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0761368 May 20 20:35:22.694925 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-e8e53bed-2bd4-494c-9e97-35a764cd36d4 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265709 May 20 20:35:22.890712 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'a4805426-4e85-42a9-b3aa-15dad628ae73', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'port_id': '2abde94a-966c-4288-b8cb-201a164e69b0', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'mac_address': 'fa:16:3e:40:8a:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:35:07Z', 'updated_at': '2021-05-20T20:35:20Z', 'revision_number': 1, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:35:22.894910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-271d3dc7-48af-47ca-a99f-a55a51602d03 None None] The sync data for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi is: [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'a4805426-4e85-42a9-b3aa-15dad628ae73', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'port_id': '2abde94a-966c-4288-b8cb-201a164e69b0', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'mac_address': 'fa:16:3e:40:8a:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:35:07Z', 'updated_at': '2021-05-20T20:35:20Z', 'revision_number': 1, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:35:22.931365 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d11110bd-aced-42e9-97ff-df13c7d79389 req-82235a59-91e4-4185-8ef7-91389cd43907 service neutron] 10.222.0.69 "GET /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2262650 May 20 20:35:23.094565 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54399de2-63eb-40d3-a73d-1f0e61e37cbe None None] New status for floating IP a4805426-4e85-42a9-b3aa-15dad628ae73: ACTIVE {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:35:23.203686 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c79511-4491-4ff8-97d9-ca85ee47261d req-d8d37032-dfe9-4c94-b207-da46b5279d19 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:23.205832 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e1c79511-4491-4ff8-97d9-ca85ee47261d req-d8d37032-dfe9-4c94-b207-da46b5279d19 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0845358 May 20 20:35:23.251441 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e1c79511-4491-4ff8-97d9-ca85ee47261d req-fe0124a5-209f-4f97-8f2b-4b7d6d77b7b7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385032 May 20 20:35:24.449168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c411df7-cbb7-4d38-b419-820692e21e8d req-d5842b47-a3e9-4c6d-b6db-8722aea67d7b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:24.450670 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c411df7-cbb7-4d38-b419-820692e21e8d req-d5842b47-a3e9-4c6d-b6db-8722aea67d7b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0842736 May 20 20:35:24.496998 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c411df7-cbb7-4d38-b419-820692e21e8d req-2514372f-0885-4219-8b05-44962b17b23c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402913 May 20 20:35:25.691437 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff25dd4f-d8c9-4314-980a-6a3c1d6173e0 req-09f7232e-a87a-4ef3-8785-7a65d23b75d1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:25.692842 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ff25dd4f-d8c9-4314-980a-6a3c1d6173e0 req-09f7232e-a87a-4ef3-8785-7a65d23b75d1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0822337 May 20 20:35:25.739329 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ff25dd4f-d8c9-4314-980a-6a3c1d6173e0 req-c9d90c0b-4e56-46e4-b802-eb29c9413fb4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406966 May 20 20:35:26.808960 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:35:26.934652 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95156865-f58d-46cd-bf25-e53862c4fd7e req-270fab25-2090-46fc-8e6e-34229e6926cb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:26.936127 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-95156865-f58d-46cd-bf25-e53862c4fd7e req-270fab25-2090-46fc-8e6e-34229e6926cb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0833185 May 20 20:35:26.981187 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-95156865-f58d-46cd-bf25-e53862c4fd7e req-18b1cf0c-01f8-4184-a219-d7a7eea965ce tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392780 May 20 20:35:28.168766 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2261bc-2801-4210-8562-e7ca92eee1d6 req-fff8f007-cd7f-4ab3-835a-b29173c362fd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:28.170239 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0a2261bc-2801-4210-8562-e7ca92eee1d6 req-fff8f007-cd7f-4ab3-835a-b29173c362fd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0786426 May 20 20:35:28.215312 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0a2261bc-2801-4210-8562-e7ca92eee1d6 req-85adafb8-72bb-4f72-a561-9d278ccc7568 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392830 May 20 20:35:29.408284 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451daa4a-bc80-44af-9aa4-7f63e2dcb586 req-425bda3a-9511-4d90-a942-892062fe4275 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:29.409742 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-451daa4a-bc80-44af-9aa4-7f63e2dcb586 req-425bda3a-9511-4d90-a942-892062fe4275 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0831811 May 20 20:35:29.455041 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-451daa4a-bc80-44af-9aa4-7f63e2dcb586 req-339d986b-0e54-4fc3-9f33-399f451ecb70 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383272 May 20 20:35:30.646941 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152d1684-bb00-4864-9974-4d7c0065140a req-1f5fb836-4755-4d6c-b5ab-e55a1b12e330 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:30.648546 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-152d1684-bb00-4864-9974-4d7c0065140a req-1f5fb836-4755-4d6c-b5ab-e55a1b12e330 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0803068 May 20 20:35:30.696215 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-152d1684-bb00-4864-9974-4d7c0065140a req-a22d2c48-8615-4802-bfef-6f081f299038 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419545 May 20 20:35:32.030532 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3613c646-42a8-4c05-b9b3-e75adf7c8a6b req-f2ab06b5-5e0d-459f-a9fa-d26169a7121a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:32.032054 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3613c646-42a8-4c05-b9b3-e75adf7c8a6b req-f2ab06b5-5e0d-459f-a9fa-d26169a7121a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0805681 May 20 20:35:32.080413 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3613c646-42a8-4c05-b9b3-e75adf7c8a6b req-9b885b60-0f0d-4002-b2d5-b163af02c381 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423572 May 20 20:35:33.277266 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62c1c7a9-4384-4113-875e-93640d63b606 req-0953b9e1-a655-4f5b-85bf-23d9b987bf7e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:33.278811 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62c1c7a9-4384-4113-875e-93640d63b606 req-0953b9e1-a655-4f5b-85bf-23d9b987bf7e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0849490 May 20 20:35:33.325863 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-62c1c7a9-4384-4113-875e-93640d63b606 req-fc3d81ae-7126-47f1-b2b4-382e9f652c1a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407441 May 20 20:35:34.515218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d1652db-785f-44e6-9f7f-e3ea98370e24 req-552455b9-7388-4386-8b8e-ac6e20e3d65b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:34.516717 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8d1652db-785f-44e6-9f7f-e3ea98370e24 req-552455b9-7388-4386-8b8e-ac6e20e3d65b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0832777 May 20 20:35:34.562709 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8d1652db-785f-44e6-9f7f-e3ea98370e24 req-e250fbed-6dfd-4689-ad53-f25858f2c610 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402527 May 20 20:35:34.770524 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-68635b0f-67a1-4742-87fd-18ed24c3ab50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:35.777345 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb83504b-c7fb-4c7a-adce-8d2588ebc311 req-f8a603ea-ec4f-45e1-b572-167a31038ad6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:35.778792 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fb83504b-c7fb-4c7a-adce-8d2588ebc311 req-f8a603ea-ec4f-45e1-b572-167a31038ad6 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0935874 May 20 20:35:35.824300 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fb83504b-c7fb-4c7a-adce-8d2588ebc311 req-fd0392eb-b163-411e-9da3-d3a4d594255b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398209 May 20 20:35:37.019422 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec2fce9-76c7-4f68-88d2-2a07062be3b8 req-17ff43ec-8672-49b4-bca3-867efed63ca5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:37.020868 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ec2fce9-76c7-4f68-88d2-2a07062be3b8 req-17ff43ec-8672-49b4-bca3-867efed63ca5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0835543 May 20 20:35:37.071049 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1ec2fce9-76c7-4f68-88d2-2a07062be3b8 req-fc3f51df-45cc-4ba8-8361-f1eab99a9c45 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431132 May 20 20:35:37.211100 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:37.303211 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:35:37.434567 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:37.447464 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'port_id': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'mac_address': 'fa:16:3e:18:fe:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 840, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:35:37.511582 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ef08b14f-32f1-4ddc-a16d-6924a038f8a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:37.514532 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:37.531220 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 5c067b29-7c3f-4485-a9cb-8822d9b39a76 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:35:37.547150 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:37.551313 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:37.553470 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:37.624120 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=6']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:37.629163 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:37.718089 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['5c067b29-7c3f-4485-a9cb-8822d9b39a76'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:35:38.301854 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:38.385672 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8846cc90-85c5-4dde-8657-6f87e72681b7 req-671b0568-0a0e-450e-8044-dd5cc077c976 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:38.388495 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8846cc90-85c5-4dde-8657-6f87e72681b7 req-671b0568-0a0e-450e-8044-dd5cc077c976 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 945 time: 0.2049606 May 20 20:35:38.443651 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-8846cc90-85c5-4dde-8657-6f87e72681b7 req-fcdf64f2-9856-4cd3-aa38-549072c4c90e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488825 May 20 20:35:39.241464 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44154) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:39.317279 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:35:39.391618 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.392494 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:35:39.392866 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.411139 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:35:39.416070 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Usage tracker for resource:security_group_rule and tenant:a7f6768d03484af3bc2e945376cc6241 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:35:39.419799 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:35:39.425649 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:35:39.546472 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.573831 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.578764 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:35:39.581839 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.590563 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:39.595376 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.598566 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:39.664216 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-12a9cb3a-29e0-4cc2-845c-2cdac2bbcc5a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:39.678085 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=7']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:39.683530 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:39.704250 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce7a7d07-a3ac-4e65-95ef-5eb6586490c6,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:39.739285 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.739647 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.740035 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.740426 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.740816 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.741167 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.741512 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.741859 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.742945 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.743343 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.743693 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.744094 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:35:39.753549 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:39.756425 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-bc97a0c4-02d0-4d69-8a0a-ee39ec9dbe67 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a7f6768d03484af3bc2e945376cc6241&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5133100 May 20 20:35:39.759225 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44164) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:35:39.782460 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145e9a71-8c7b-4dee-a705-278bd6f6a09c req-6b65ce75-e638-4f8c-8079-3bfc9b8045c2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:39.784321 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-145e9a71-8c7b-4dee-a705-278bd6f6a09c req-6b65ce75-e638-4f8c-8079-3bfc9b8045c2 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.1824274 May 20 20:35:39.813178 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'code': 200} May 20 20:35:39.829431 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e3b35957-d88a-4271-acaf-c81b6323252e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.847592 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-145e9a71-8c7b-4dee-a705-278bd6f6a09c req-32f35169-6f7e-45ea-a559-a48c955b76ad tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567181 May 20 20:35:39.863129 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e3b35957-d88a-4271-acaf-c81b6323252e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.916058 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.936296 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e3b35957-d88a-4271-acaf-c81b6323252e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.940414 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ec83dd26-68d6-47fb-b9bf-23e91d470376 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:39.951731 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b35957-d88a-4271-acaf-c81b6323252e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce7a7d07-a3ac-4e65-95ef-5eb6586490c6,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:39.955566 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e3b35957-d88a-4271-acaf-c81b6323252e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:39.963906 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e3b35957-d88a-4271-acaf-c81b6323252e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:39.967989 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e3b35957-d88a-4271-acaf-c81b6323252e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ce7a7d07-a3ac-4e65-95ef-5eb6586490c6 HTTP/1.1" status: 204 len: 168 time: 0.2077935 May 20 20:35:41.043183 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19c260a-08e7-4dbf-8179-b7482bbd7594 req-47a0ef5b-e199-45e1-89d1-97e638c27066 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:41.044910 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a19c260a-08e7-4dbf-8179-b7482bbd7594 req-47a0ef5b-e199-45e1-89d1-97e638c27066 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0890396 May 20 20:35:41.095429 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a19c260a-08e7-4dbf-8179-b7482bbd7594 req-9a339763-551f-4ab7-85e2-bbde15001acc tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439210 May 20 20:35:42.310864 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc6ebe0-2086-4053-a701-7004c19a9645 req-c8370317-0423-407f-8631-d14afb26e10e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:42.316222 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3cc6ebe0-2086-4053-a701-7004c19a9645 req-c8370317-0423-407f-8631-d14afb26e10e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0973828 May 20 20:35:42.361649 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3cc6ebe0-2086-4053-a701-7004c19a9645 req-14f2fab7-9c7d-457f-8211-0481e1d0c049 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435300 May 20 20:35:43.587853 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be64f42f-d275-4b0a-8344-55c0f0b34e99 req-3bcaedac-e554-422b-8912-c979378be93e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:43.589347 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-be64f42f-d275-4b0a-8344-55c0f0b34e99 req-3bcaedac-e554-422b-8912-c979378be93e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0962367 May 20 20:35:43.638001 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-be64f42f-d275-4b0a-8344-55c0f0b34e99 req-54a05739-03fa-45be-9d98-79d5a5e950b7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426342 May 20 20:35:44.849134 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96c998e-b58a-4880-80fe-57a73e8e4b32 req-eb6314a2-ba0f-487c-8203-55b7c6f588e8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:44.852373 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b96c998e-b58a-4880-80fe-57a73e8e4b32 req-eb6314a2-ba0f-487c-8203-55b7c6f588e8 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0835066 May 20 20:35:44.911628 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b96c998e-b58a-4880-80fe-57a73e8e4b32 req-f2084c09-6aff-469e-aad9-78ab0ababf87 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493963 May 20 20:35:45.065243 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:46.122268 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b97639ea-a529-4068-afca-e15b58e2f436 req-e223efdf-42cb-4125-8c3e-5eb661add215 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:46.129442 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b97639ea-a529-4068-afca-e15b58e2f436 req-e223efdf-42cb-4125-8c3e-5eb661add215 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0962536 May 20 20:35:46.171802 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b97639ea-a529-4068-afca-e15b58e2f436 req-8cc5263c-4d53-494d-b6f1-cf4631db48c7 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414805 May 20 20:35:47.369522 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562ede10-bea3-4817-835e-20575d227b8c req-604e390d-58d3-4833-879a-2d3c1773a3ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:47.370972 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-562ede10-bea3-4817-835e-20575d227b8c req-604e390d-58d3-4833-879a-2d3c1773a3ac tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0806062 May 20 20:35:47.415669 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-562ede10-bea3-4817-835e-20575d227b8c req-011764d2-c686-4fce-b295-22a3c1a33fcb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389585 May 20 20:35:48.010210 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-a79e701c-d3ae-4ec2-a275-b7bb953f686d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:48.011703 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-a79e701c-d3ae-4ec2-a275-b7bb953f686d service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 1099 time: 0.0761814 May 20 20:35:48.152577 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-ac75de25-b87b-467d-945b-fd50a4e60364 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:48.153994 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-ac75de25-b87b-467d-945b-fd50a4e60364 service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1274142 May 20 20:35:48.263035 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-632a6e2c-159e-4555-bdb9-623ad614af2c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76 HTTP/1.1" status: 200 len: 1001 time: 0.0984173 May 20 20:35:48.336138 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-aa19a2fd-d4e1-4fbd-b97c-71b03af23896 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:48.337552 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-aa19a2fd-d4e1-4fbd-b97c-71b03af23896 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.0580404 May 20 20:35:48.419116 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-d81870b1-7bf2-4026-aa26-95da54cad1b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:48.420552 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-d81870b1-7bf2-4026-aa26-95da54cad1b0 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0700128 May 20 20:35:48.560972 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-74e537e2-497e-4f5b-bd1d-2e716d8e0a4c service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1289806 May 20 20:35:48.611290 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c946355e-3d29-4148-adc4-5d57b66c00ba req-4da2da68-b1e4-49f7-ae74-b826ba2924f5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:48.613180 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c946355e-3d29-4148-adc4-5d57b66c00ba req-4da2da68-b1e4-49f7-ae74-b826ba2924f5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0835881 May 20 20:35:48.658588 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c946355e-3d29-4148-adc4-5d57b66c00ba req-d88af2b2-5dea-4da3-bf01-0ca3e97094ca tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393474 May 20 20:35:48.699140 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-083b849b-d772-420f-8fb2-7bee5cc3203f req-955c57f8-8e83-4009-ae75-4e55591ae4c4 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256223 May 20 20:35:49.848909 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe67434-2eca-4d73-b386-48429020d74b req-aea883bb-4432-4781-ac2b-b7ad905daf3c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:49.850250 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7fe67434-2eca-4d73-b386-48429020d74b req-aea883bb-4432-4781-ac2b-b7ad905daf3c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0812085 May 20 20:35:49.894382 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7fe67434-2eca-4d73-b386-48429020d74b req-55d6219e-58b3-46e8-9e9c-16e3808c7f6b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383315 May 20 20:35:51.085229 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fba503f-e4b3-4b01-846e-10a24a2d739b req-beada4e9-c32f-4640-be4d-4fc8d0e07a3d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:51.087205 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1fba503f-e4b3-4b01-846e-10a24a2d739b req-beada4e9-c32f-4640-be4d-4fc8d0e07a3d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 946 time: 0.0805907 May 20 20:35:51.132083 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1fba503f-e4b3-4b01-846e-10a24a2d739b req-7d0a6159-f413-4173-806e-718ffbdece48 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385697 May 20 20:35:51.402247 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:35:51.516353 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:51.544154 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:35:51.553593 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:35:51.559061 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:35:51.561812 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:35:51.599737 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'code': 200} May 20 20:35:51.633995 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=8']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:35:51.637179 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:35:52.324536 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df77be7-2acf-4a5e-9557-53a5e16a34a7 req-2e32a5ac-ca73-40c1-8788-709dd9f2801d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:52.325997 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6df77be7-2acf-4a5e-9557-53a5e16a34a7 req-2e32a5ac-ca73-40c1-8788-709dd9f2801d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0820513 May 20 20:35:52.370359 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6df77be7-2acf-4a5e-9557-53a5e16a34a7 req-f1d89332-4fc0-4a7b-9bcb-11afe30f279a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386908 May 20 20:35:53.882387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1583720-09f4-4120-8476-8ea321456571 req-cf7626b5-5afa-4974-9047-6fdca8431444 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:53.883872 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e1583720-09f4-4120-8476-8ea321456571 req-cf7626b5-5afa-4974-9047-6fdca8431444 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0836403 May 20 20:35:53.929777 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e1583720-09f4-4120-8476-8ea321456571 req-1d68edaa-f2cf-4d30-882f-b16fc4514cb9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389392 May 20 20:35:54.104946 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-9cc93ce8-9085-4203-a85c-3b9fad5c4677 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0702391 May 20 20:35:55.129118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a75e4b-991c-4bf8-98af-18160880b62b req-d38ddf26-a4a9-49bc-aa71-98afa349ea2a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:55.130579 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d3a75e4b-991c-4bf8-98af-18160880b62b req-d38ddf26-a4a9-49bc-aa71-98afa349ea2a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0856376 May 20 20:35:55.221987 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d3a75e4b-991c-4bf8-98af-18160880b62b req-d352b0e3-2973-4d37-ace3-3488455021b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0849164 May 20 20:35:55.242348 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-b5661e14-7ba9-4540-be0e-f2074d4d2566 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:55.243826 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-b5661e14-7ba9-4540-be0e-f2074d4d2566 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443&tenant_id=d5d038c87b86437990c22a9e55b308b6 HTTP/1.1" status: 200 len: 1097 time: 0.0919633 May 20 20:35:55.349355 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-66d43a76-c18f-4e8b-a43a-2f03f7ddb511 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:55.350829 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-66d43a76-c18f-4e8b-a43a-2f03f7ddb511 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d5d038c87b86437990c22a9e55b308b6&device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 1097 time: 0.0772130 May 20 20:35:55.424765 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:35:55.492483 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-33f6690b-7584-40d3-8b1c-86af15c4b99f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:55.493827 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-33f6690b-7584-40d3-8b1c-86af15c4b99f service neutron] 10.222.0.69 "GET /v2.0/networks?id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 200 len: 918 time: 0.1322525 May 20 20:35:55.598414 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-cbe00b18-fa9c-4113-9c58-650ea9af2d31 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76 HTTP/1.1" status: 200 len: 999 time: 0.0930476 May 20 20:35:55.755835 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-b449f40b-3ba6-4718-ae62-4554ac596d82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:55.757186 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-b449f40b-3ba6-4718-ae62-4554ac596d82 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 200 len: 856 time: 0.1473026 May 20 20:35:55.843750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-87abfc48-3ef6-49c7-b762-b1898e662396 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:55.845231 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-87abfc48-3ef6-49c7-b762-b1898e662396 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0725286 May 20 20:35:55.981148 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-a4d0a27d-1ce0-4539-a2fd-615f093b7ebe service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237769 May 20 20:35:56.116840 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-60b411fd-d493-4308-9626-3821b65db792 service neutron] 10.222.0.69 "GET /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1228220 May 20 20:35:56.415732 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc54c5f6-c35f-4f29-ae27-504a2b7cf06a req-7e8c94f9-9466-4eef-9e72-0914df51c9b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:56.418023 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bc54c5f6-c35f-4f29-ae27-504a2b7cf06a req-7e8c94f9-9466-4eef-9e72-0914df51c9b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0818799 May 20 20:35:56.465328 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-bc54c5f6-c35f-4f29-ae27-504a2b7cf06a req-7231fa3f-4e23-42f5-8359-349be54fd6ae tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413921 May 20 20:35:57.663708 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e39ba1-9fd6-477a-a4b0-f0411ea410a9 req-590fa75f-1d7e-4ab3-98ce-b5952d8fa7c0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:57.665231 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e7e39ba1-9fd6-477a-a4b0-f0411ea410a9 req-590fa75f-1d7e-4ab3-98ce-b5952d8fa7c0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0871887 May 20 20:35:57.711143 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e7e39ba1-9fd6-477a-a4b0-f0411ea410a9 req-74e80042-3e40-4b99-b844-952afc5d80da tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388994 May 20 20:35:58.908311 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae0a546-db47-4e51-a01d-bcbaf690d026 req-9fb5b9a5-0269-4dad-922f-03242b6b5f75 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:35:58.909791 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7ae0a546-db47-4e51-a01d-bcbaf690d026 req-9fb5b9a5-0269-4dad-922f-03242b6b5f75 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0840137 May 20 20:35:58.957332 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7ae0a546-db47-4e51-a01d-bcbaf690d026 req-192b25b7-4289-44f0-a9bd-3563699daebe tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417540 May 20 20:36:00.161367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d434945-8840-4af0-971d-376473fdcf17 req-c0ec7f2b-a376-49a0-85fc-86272a4f9dbb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:00.162841 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5d434945-8840-4af0-971d-376473fdcf17 req-c0ec7f2b-a376-49a0-85fc-86272a4f9dbb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0887725 May 20 20:36:00.210682 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5d434945-8840-4af0-971d-376473fdcf17 req-023385b1-134c-4e6f-bf44-5455d27b5424 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413370 May 20 20:36:01.401255 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f5bbfa-4f1c-4981-81f8-8045531c6786 req-083fddf8-fc27-4730-80a8-a71e129cdd5d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:01.403186 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-01f5bbfa-4f1c-4981-81f8-8045531c6786 req-083fddf8-fc27-4730-80a8-a71e129cdd5d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0803216 May 20 20:36:01.453554 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-01f5bbfa-4f1c-4981-81f8-8045531c6786 req-cc05f1c5-cd2f-4301-a017-3c2502ba3b50 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440688 May 20 20:36:02.646136 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5aef31-0d8a-432f-a1ca-e84250dc015a req-75b737e9-25ef-42d4-8a89-6b46cf2fb046 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:02.647597 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5aef31-0d8a-432f-a1ca-e84250dc015a req-75b737e9-25ef-42d4-8a89-6b46cf2fb046 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0820713 May 20 20:36:02.695460 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5aef31-0d8a-432f-a1ca-e84250dc015a req-f82a6e41-c90c-4468-8b51-fc0476a3285f tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409160 May 20 20:36:03.807461 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:36:03.893896 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6faf6a09-2d28-4c8a-8bc2-ee568a314f19 req-01c164d9-0547-4ea1-8d32-77537ec1f703 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:03.895374 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6faf6a09-2d28-4c8a-8bc2-ee568a314f19 req-01c164d9-0547-4ea1-8d32-77537ec1f703 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0862772 May 20 20:36:03.942872 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6faf6a09-2d28-4c8a-8bc2-ee568a314f19 req-0fe2e202-7ab6-4140-ae12-4dce5c67f50e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414810 May 20 20:36:04.806051 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-73932e2f-8785-4ae3-ba4f-f2d023fdd019 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:05.141111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c23755-9d83-4b66-93f7-07cea8f74bc9 req-24811876-adb3-41cb-8277-878b24010bf0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:05.142561 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a7c23755-9d83-4b66-93f7-07cea8f74bc9 req-24811876-adb3-41cb-8277-878b24010bf0 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0831823 May 20 20:36:05.193918 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a7c23755-9d83-4b66-93f7-07cea8f74bc9 req-7d6d9acb-2973-4aec-a51e-be57bc808739 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448756 May 20 20:36:06.391309 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e8b944-25f8-4dba-b0bc-4f2efdc00f0c req-8ebdc300-d913-42ad-aece-681eeacb034c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:06.392849 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-16e8b944-25f8-4dba-b0bc-4f2efdc00f0c req-8ebdc300-d913-42ad-aece-681eeacb034c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0866516 May 20 20:36:06.442403 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-16e8b944-25f8-4dba-b0bc-4f2efdc00f0c req-81a0aa8e-e66f-4588-9414-fca09ee2ff89 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429451 May 20 20:36:07.214984 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:07.493586 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c31085bb-924a-461e-8171-10b7b0c464b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:07.646578 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ae20a2-f26e-4b78-ab0e-3262aa5e8607 req-a147b7b6-cc8e-488e-adf5-9f70d49d76c5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:07.648023 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40ae20a2-f26e-4b78-ab0e-3262aa5e8607 req-a147b7b6-cc8e-488e-adf5-9f70d49d76c5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0837193 May 20 20:36:07.693955 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-40ae20a2-f26e-4b78-ab0e-3262aa5e8607 req-b107ec18-f1a6-4974-9091-4011dc77f4cd tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399599 May 20 20:36:08.305000 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:08.891596 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66bb7da4-829b-4d74-aa93-6a4abcedbbcd req-ad4ac776-850f-4bea-97fd-9c95440817cc tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:08.893156 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66bb7da4-829b-4d74-aa93-6a4abcedbbcd req-ad4ac776-850f-4bea-97fd-9c95440817cc tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0816798 May 20 20:36:08.941447 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66bb7da4-829b-4d74-aa93-6a4abcedbbcd req-89abbec2-ba3d-4dca-9ca8-bfa05f833ab3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424578 May 20 20:36:09.914684 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:10.144652 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bf30df-2998-4b60-9238-b0a19ba246e6 req-1c3f75f9-8be6-4fe8-8d0f-ac6e4e134821 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:10.146108 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-10bf30df-2998-4b60-9238-b0a19ba246e6 req-1c3f75f9-8be6-4fe8-8d0f-ac6e4e134821 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0858974 May 20 20:36:10.194860 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-10bf30df-2998-4b60-9238-b0a19ba246e6 req-655441e6-50e4-462f-a379-86f83a2b4be5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428104 May 20 20:36:11.396459 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b71663-3a52-4913-b014-18abf62dc8d2 req-7e8fa92d-ec65-4c92-b9f9-fcc4c48adfe5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:11.397968 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b71663-3a52-4913-b014-18abf62dc8d2 req-7e8fa92d-ec65-4c92-b9f9-fcc4c48adfe5 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0839162 May 20 20:36:11.447967 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-02b71663-3a52-4913-b014-18abf62dc8d2 req-f7cf54c4-d2dd-42b2-ae3e-be378e2823ed tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442972 May 20 20:36:12.717554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70f94dcb-326c-44d7-a9f9-2d97e85dad5a req-eee8459d-9cd9-4894-a2f2-b40903be2276 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:12.719043 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-70f94dcb-326c-44d7-a9f9-2d97e85dad5a req-eee8459d-9cd9-4894-a2f2-b40903be2276 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.1571176 May 20 20:36:12.764791 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-70f94dcb-326c-44d7-a9f9-2d97e85dad5a req-85861748-f8c1-4f60-8ec4-f07c05b42eaa tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386052 May 20 20:36:13.964867 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9106f0a7-5808-4f1c-a041-e01851679f28 req-446a4403-6ab6-4046-bc09-172429889170 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:13.966292 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9106f0a7-5808-4f1c-a041-e01851679f28 req-446a4403-6ab6-4046-bc09-172429889170 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0900962 May 20 20:36:14.015047 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9106f0a7-5808-4f1c-a041-e01851679f28 req-c19b99d1-89da-4d65-9439-8ff7078c5e3c tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425515 May 20 20:36:15.061085 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:15.214945 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61833787-9950-4f3e-bd63-17cfd74e6617 req-06d15359-983d-499a-99f9-e0386d4f86ca tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:15.216453 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-61833787-9950-4f3e-bd63-17cfd74e6617 req-06d15359-983d-499a-99f9-e0386d4f86ca tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 944 time: 0.0819890 May 20 20:36:15.265289 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-61833787-9950-4f3e-bd63-17cfd74e6617 req-eeab42b1-305e-4e01-aced-8db727572ba3 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431664 May 20 20:36:15.530374 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:36:15.661118 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:15.674758 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'port_id': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'mac_address': 'fa:16:3e:18:fe:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 840, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:36:15.729027 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:15.747623 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c067b29-7c3f-4485-a9cb-8822d9b39a76 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:36:15.763925 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:15.768484 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:15.770267 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:15.834549 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=9']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:15.841561 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.841898 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.842230 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.842555 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.842876 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.843193 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.843507 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.843843 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.844160 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.844466 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.844774 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.845080 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:15.849244 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:16.187340 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['5c067b29-7c3f-4485-a9cb-8822d9b39a76'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:36:16.457240 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c04b4cd4-14b3-4c0d-99e0-d06cddf00375 req-d6b5ef98-50d9-4686-b2d9-aa1b9a35e265 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:16.458674 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c04b4cd4-14b3-4c0d-99e0-d06cddf00375 req-d6b5ef98-50d9-4686-b2d9-aa1b9a35e265 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 945 time: 0.0801952 May 20 20:36:16.503712 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c04b4cd4-14b3-4c0d-99e0-d06cddf00375 req-03faf59a-d8fc-43f9-b241-b297dec79587 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391378 May 20 20:36:17.543223 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:36:17.610027 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:36:17.610401 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:17.697349 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4254f63e-83ae-43cd-94e9-0de3455f329a req-193531b5-223f-48ca-a142-bf47fda022c9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:17.698827 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4254f63e-83ae-43cd-94e9-0de3455f329a req-193531b5-223f-48ca-a142-bf47fda022c9 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 945 time: 0.0851517 May 20 20:36:17.729358 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:17.744287 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4254f63e-83ae-43cd-94e9-0de3455f329a req-3c49c700-54fe-4463-8b7f-1d6f6fdb2c04 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397234 May 20 20:36:17.756681 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:36:17.766902 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:17.771730 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:17.774382 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:17.805335 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'code': 200} May 20 20:36:17.842855 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=10']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:17.845617 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:18.091284 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39410e-6799-4b52-b684-9a68f3e4292d req-dc78d548-7d4c-46d5-9fd0-ab513f907f55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:18.092770 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ee39410e-6799-4b52-b684-9a68f3e4292d req-dc78d548-7d4c-46d5-9fd0-ab513f907f55 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 1100 time: 0.0685112 May 20 20:36:18.137181 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ee39410e-6799-4b52-b684-9a68f3e4292d req-87810648-4a21-4348-ba3c-a6ad1cffec2c service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324199 May 20 20:36:18.940445 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec220880-e24f-47a6-b053-9f9336de7a16 req-92035b9d-5b4b-4015-b85a-7643ccd32e81 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:18.942498 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ec220880-e24f-47a6-b053-9f9336de7a16 req-92035b9d-5b4b-4015-b85a-7643ccd32e81 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 947 time: 0.0837615 May 20 20:36:18.987019 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ec220880-e24f-47a6-b053-9f9336de7a16 req-eaad25e3-7c7e-49c5-af51-24221d1ff2ea tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386968 May 20 20:36:20.179919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa1b6f3-f2dc-4bf7-ae0b-59b7ad3aafa4 req-8c7f04cd-619a-45a5-8922-c572fd8bc58e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:20.181375 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3aa1b6f3-f2dc-4bf7-ae0b-59b7ad3aafa4 req-8c7f04cd-619a-45a5-8922-c572fd8bc58e tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 947 time: 0.0798576 May 20 20:36:20.231002 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3aa1b6f3-f2dc-4bf7-ae0b-59b7ad3aafa4 req-185e79a7-c293-4c3d-8d30-a7276160372b tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435863 May 20 20:36:21.421655 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf8b479-2eeb-456d-b0b5-ef968fbdfc2d req-be4efddb-4ab7-4b49-8d2c-c5a1ad5894cf tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:21.423101 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4cf8b479-2eeb-456d-b0b5-ef968fbdfc2d req-be4efddb-4ab7-4b49-8d2c-c5a1ad5894cf tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 947 time: 0.0798664 May 20 20:36:21.468277 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4cf8b479-2eeb-456d-b0b5-ef968fbdfc2d req-3b683269-429c-441c-a270-6ac3b78d0a32 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384011 May 20 20:36:34.422248 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44460) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:34.767837 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9365ede4-e436-4dbc-b6a0-485608189935 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:34.783913 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Deleting port 0871a2a1-32fb-4e72-8bbd-4ee49b62fa7c {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:34.784256 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:34.904532 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:34.904859 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:35.032626 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Calling delete_port for 0871a2a1-32fb-4e72-8bbd-4ee49b62fa7c owned by network:floatingip {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:35.158622 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:35.163259 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-aeabc50c-b7b4-4615-935b-d3b766db5f43 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:35.207101 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event deleted for resources: {'Port': ['ID=0871a2a1-32fb-4e72-8bbd-4ee49b62fa7c,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:35.240546 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:35.298053 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for floatingip, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:35.298379 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.l3_db [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Floating IP ed522ab9-dfc3-4e3d-bceb-ddda4cba0995 disassociated (deleted). External IP: 172.27.3.114, port: 8901084c-f60b-4b41-82bc-2d359b04000f. May 20 20:36:35.645367 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Router e82a2c25-7086-45e3-b880-9d510f38463a has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:36:35.823392 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:36:35.832588 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] Sync routers for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:36:35.843248 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:36:35.843893 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:35.851588 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:35.908668 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-86611c44-4f88-4792-8028-b75090b6d44b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "DELETE /v2.0/floatingips/ed522ab9-dfc3-4e3d-bceb-ddda4cba0995 HTTP/1.1" status: 204 len: 168 time: 1.4851589 May 20 20:36:35.909142 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:36:35.963209 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f', 'status': 'completed', 'code': 200} May 20 20:36:36.029215 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:36:36.078146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-7aa8ca8a-8d42-4826-b79d-e61a6e99ce65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:36.080354 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-7aa8ca8a-8d42-4826-b79d-e61a6e99ce65 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 1098 time: 0.0869944 May 20 20:36:36.234031 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-2ffdc6f7-cbbf-40db-b106-416a40eb0c6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:36.235474 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-2ffdc6f7-cbbf-40db-b106-416a40eb0c6c service neutron] 10.222.0.69 "GET /v2.0/networks?id=9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 200 len: 909 time: 0.1384170 May 20 20:36:36.288833 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8aed45-a569-4abf-9cd2-98d5dac00996 req-b2a3c706-d4d0-4b59-b3b0-ed4f979d97ff tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:36.289543 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-9c8aed45-a569-4abf-9cd2-98d5dac00996 req-b2a3c706-d4d0-4b59-b3b0-ed4f979d97ff tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Synchronizing usage tracker for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:36:36.305847 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-9c8aed45-a569-4abf-9cd2-98d5dac00996 req-b2a3c706-d4d0-4b59-b3b0-ed4f979d97ff tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Unset dirty status for tenant:bf9ff50b3c4f4f7e8afcf9c87cade238 on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:36:36.307204 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9c8aed45-a569-4abf-9cd2-98d5dac00996 req-b2a3c706-d4d0-4b59-b3b0-ed4f979d97ff tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.1019135 May 20 20:36:36.313640 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-6c2552c8-8fb0-4965-b8f5-5e9fcc92d3f7 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 200 len: 217 time: 0.0658991 May 20 20:36:36.355866 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9c8aed45-a569-4abf-9cd2-98d5dac00996 req-a1ff7f99-884f-49a9-8b8a-61b950b07dfe tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423694 May 20 20:36:36.381852 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-1aceb984-636b-404f-a22c-01116aa1f060 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:36.383302 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-1aceb984-636b-404f-a22c-01116aa1f060 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 200 len: 847 time: 0.0601425 May 20 20:36:36.410575 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 5, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:36.415067 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] Checking router: e82a2c25-7086-45e3-b880-9d510f38463a for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:36:36.423633 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:36:36.424283 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:36.463223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-704f439d-d812-45cb-93ab-23175c6c6149 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:36.464637 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-704f439d-d812-45cb-93ab-23175c6c6149 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9c4884cd-a197-48ab-a497-3c07afe55035&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0698383 May 20 20:36:36.601078 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:36:36.605280 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-63ebce15-f2cc-4a90-9e81-091ed361a547 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261413 May 20 20:36:36.742878 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44a04dc8-d6ea-491b-89b5-82ceb645b0ce req-63fbcb29-efe8-4e18-98d0-a28970b223a0 service neutron] 10.222.0.69 "GET /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253099 May 20 20:36:36.908612 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 5, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:36.913318 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e04fdb9-eea1-4223-a497-e8bb41c1cd40 None None] The sync data for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi is: [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:28:28Z', 'revision_number': 4, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': 'a0794e95-f731-4932-8b25-f1ff4aaa7426', 'name': '', 'network_id': '9c4884cd-a197-48ab-a497-3c07afe55035', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'mac_address': 'fa:16:3e:3a:c3:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:27Z', 'updated_at': '2021-05-20T20:28:36Z', 'revision_number': 5, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'subnets': [{'id': '845e6d5e-4ee4-43a5-a910-0fd3f1657178', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:36:37.116660 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2f7f9e1-72df-47da-842a-587dfd678ac4 None None] New status for floating IP ed522ab9-dfc3-4e3d-bceb-ddda4cba0995: DOWN {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:36:37.217321 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:37.495839 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5105527b-001e-474f-a413-6212a98507b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:37.550319 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f1d74c-74d9-4aae-bfdf-0f9c59b71c89 req-832acc1d-ed8a-49b8-9a77-ca6f4e53f926 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:37.551642 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f3f1d74c-74d9-4aae-bfdf-0f9c59b71c89 req-832acc1d-ed8a-49b8-9a77-ca6f4e53f926 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0861590 May 20 20:36:37.595618 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f3f1d74c-74d9-4aae-bfdf-0f9c59b71c89 req-c24ca190-25cd-4ebe-b5fa-29b7d6855c15 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377972 May 20 20:36:38.309223 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:38.673570 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-c963a7fa-9b8f-4d1d-be4c-3318885f0b84 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:38.674983 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-c963a7fa-9b8f-4d1d-be4c-3318885f0b84 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.69 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0817316 May 20 20:36:38.789679 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3821ea3f-2dac-44a3-92ca-29aa527b5859 req-fb3af580-01e0-4cfa-8456-6c48cf56fb5b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:38.791155 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3821ea3f-2dac-44a3-92ca-29aa527b5859 req-fb3af580-01e0-4cfa-8456-6c48cf56fb5b tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 945 time: 0.0789039 May 20 20:36:38.814356 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Deleting port 8901084c-f60b-4b41-82bc-2d359b04000f {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:38.814691 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:38.948574 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3821ea3f-2dac-44a3-92ca-29aa527b5859 req-ac4d6c48-0b50-4099-a717-320e7bd130af tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/security-groups?id=5ec7237a-3e86-4e4b-b272-c39dc89160c5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1512682 May 20 20:36:39.038914 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] For port 8901084c-f60b-4b41-82bc-2d359b04000f, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=8901084c-f60b-4b41-82bc-2d359b04000f,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:39.039259 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:39.161614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Calling delete_port for 8901084c-f60b-4b41-82bc-2d359b04000f owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:39.278876 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:39.284485 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:39.331598 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event deleted for resources: {'Port': ['ID=8901084c-f60b-4b41-82bc-2d359b04000f,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:39.367479 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.367865 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.368219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.368566 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.368909 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.369252 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.369589 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.369924 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.370259 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.370593 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.370925 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.371254 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:39.378554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:39.418560 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] No DVR routers for this DVR port 8901084c-f60b-4b41-82bc-2d359b04000f on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:36:39.420994 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:39.423542 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-deleted', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:36:39.439378 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6346366d-83f1-4cca-a9a1-9ecaa2b1cc3b req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.69 "DELETE /v2.0/ports/8901084c-f60b-4b41-82bc-2d359b04000f HTTP/1.1" status: 204 len: 173 time: 0.7536042 May 20 20:36:39.470369 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd8abe0da-8201-46d5-b370-da08c19f0ef9', 'name': 'network-vif-deleted', 'tag': '8901084c-f60b-4b41-82bc-2d359b04000f', 'status': 'completed', 'code': 200} May 20 20:36:39.916338 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:40.102187 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-07c3304a-00cf-4fa7-8b92-cb07bba8eeab req-6b248fcf-5279-47bb-9f0f-224b44942673 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "GET /v2.0/ports?device_id=d8abe0da-8201-46d5-b370-da08c19f0ef9 HTTP/1.1" status: 200 len: 210 time: 0.0457196 May 20 20:36:40.807188 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:36:41.196903 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44492) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:41.268546 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c0f450f6-2e78-4894-b20b-1d40816b9689 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:41.297956 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c0f450f6-2e78-4894-b20b-1d40816b9689 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:41.363201 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c0f450f6-2e78-4894-b20b-1d40816b9689 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:41.367886 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-058d8032-7b81-4efb-9500-efd21afcd64c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:41.383869 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f450f6-2e78-4894-b20b-1d40816b9689 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ec7237a-3e86-4e4b-b272-c39dc89160c5,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:41.386380 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c0f450f6-2e78-4894-b20b-1d40816b9689 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:41.395054 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c0f450f6-2e78-4894-b20b-1d40816b9689 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:41.396195 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c0f450f6-2e78-4894-b20b-1d40816b9689 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] 10.222.0.82 "DELETE /v2.0/security-groups/5ec7237a-3e86-4e4b-b272-c39dc89160c5 HTTP/1.1" status: 204 len: 168 time: 0.1983397 May 20 20:36:41.450714 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44498) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:41.668282 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8901084c-f60b-4b41-82bc-2d359b04000f no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:36:41.707554 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 8901084c-f60b-4b41-82bc-2d359b04000f {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:36:41.708208 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 8901084c-f60b-4b41-82bc-2d359b04000f not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:36:42.175381 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:42.681129 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Deleting port a0794e95-f731-4932-8b25-f1ff4aaa7426 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:42.681855 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:42.798989 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] For port a0794e95-f731-4932-8b25-f1ff4aaa7426, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=a0794e95-f731-4932-8b25-f1ff4aaa7426,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:42.799343 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:42.923420 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Calling delete_port for a0794e95-f731-4932-8b25-f1ff4aaa7426 owned by network:router_interface {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:43.069814 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:43.073191 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:43.142703 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Pushing event deleted for resources: {'Port': ['ID=a0794e95-f731-4932-8b25-f1ff4aaa7426,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:43.145202 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:43.386039 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:43.761227 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Router e82a2c25-7086-45e3-b880-9d510f38463a has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:36:44.049699 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:36:44.060241 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] Sync routers for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:36:44.065519 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] 10.222.0.82 "PUT /v2.0/routers/e82a2c25-7086-45e3-b880-9d510f38463a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6114047 May 20 20:36:44.065773 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44530) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:44.069802 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:36:44.070443 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:44.241455 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks [] for router, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:44.243056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:36:44.411856 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:44.488462 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Deleting port 02de7cb4-1bc7-4e00-884a-b24a3093df70 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:44.488697 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:44.534731 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90'}], 'enable_snat': True}, 'gw_port_id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:36:43Z', 'revision_number': 5, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port': {'id': '02de7cb4-1bc7-4e00-884a-b24a3093df70', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:eb:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 254, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:23Z', 'updated_at': '2021-05-20T20:28:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:44.539245 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] Checking router: e82a2c25-7086-45e3-b880-9d510f38463a for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:36:44.547799 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] Routers {'e82a2c25-7086-45e3-b880-9d510f38463a'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:36:44.548413 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e82a2c25-7086-45e3-b880-9d510f38463a'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:44.614890 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] For port 02de7cb4-1bc7-4e00-884a-b24a3093df70, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=02de7cb4-1bc7-4e00-884a-b24a3093df70,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:44.615236 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:44.695191 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] Set router e82a2c25-7086-45e3-b880-9d510f38463a gateway port host: None {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:36:44.745106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Calling delete_port for 02de7cb4-1bc7-4e00-884a-b24a3093df70 owned by network:router_gateway {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:44.837435 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:36:44Z', 'revision_number': 6, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:44.841411 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8287feb0-da52-4e45-a610-32fd5e1096f4 None None] The sync data for ids ['e82a2c25-7086-45e3-b880-9d510f38463a'] in dv-cinder-784623-13-iscsi is: [{'id': 'e82a2c25-7086-45e3-b880-9d510f38463a', 'name': 'tempest-TestShelveInstance-693066299-router', 'tenant_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:22Z', 'updated_at': '2021-05-20T20:36:44Z', 'revision_number': 6, 'project_id': 'bf9ff50b3c4f4f7e8afcf9c87cade238', 'gw_port_host': None}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:36:44.890923 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:44.894688 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:44.938064 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Pushing event deleted for resources: {'Port': ['ID=02de7cb4-1bc7-4e00-884a-b24a3093df70,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:44.940525 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:45.032537 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.076348 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.207992 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.211348 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.236223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.236825 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e82a2c25-7086-45e3-b880-9d510f38463a {{(pid=91646) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:36:45.250393 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.251515 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] 10.222.0.82 "DELETE /v2.0/routers/e82a2c25-7086-45e3-b880-9d510f38463a HTTP/1.1" status: 204 len: 168 time: 1.1848426 May 20 20:36:45.254049 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44536) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:45.313208 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Deleting subnet 845e6d5e-4ee4-43a5-a910-0fd3f1657178 {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:36:45.316219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.367642 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.591004 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.835659 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.839344 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:45.875724 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=845e6d5e-4ee4-43a5-a910-0fd3f1657178,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:45.878556 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:45.879510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:45.886586 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-48cb10d9-842e-4f61-9f1a-c6ddf4ef123b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/845e6d5e-4ee4-43a5-a910-0fd3f1657178 HTTP/1.1" status: 204 len: 168 time: 0.6315603 May 20 20:36:45.886811 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd6a08bf-dd37-4dd7-be29-6d630e4b1566 None None] Network 9c4884cd-a197-48ab-a497-3c07afe55035 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:36:45.889147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44540) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:45.966218 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device a0794e95-f731-4932-8b25-f1ff4aaa7426 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:36:45.995574 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.006789 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: a0794e95-f731-4932-8b25-f1ff4aaa7426 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:36:46.007123 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device a0794e95-f731-4932-8b25-f1ff4aaa7426 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:36:46.007535 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 02de7cb4-1bc7-4e00-884a-b24a3093df70 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:36:46.048618 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 02de7cb4-1bc7-4e00-884a-b24a3093df70 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:36:46.049387 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 02de7cb4-1bc7-4e00-884a-b24a3093df70 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:36:46.071612 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Deleting port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:46.071986 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.174286 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] For port b29eaf10-987b-4e3f-96b8-bb2cc38ba477, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:46.174699 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.199851 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] DHCP port deletion for 9c4884cd-a197-48ab-a497-3c07afe55035 request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:36:46.263468 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Deleting port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:46.263976 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.304105 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Calling delete_port for b29eaf10-987b-4e3f-96b8-bb2cc38ba477 owned by network:dhcp {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:46.350795 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.356038 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:46.364233 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] For port b29eaf10-987b-4e3f-96b8-bb2cc38ba477, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,segment=NetworkSegment(4626296e-819f-49b9-8f67-944cc7c115da),segment_id=4626296e-819f-49b9-8f67-944cc7c115da)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:46.364664 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.399531 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Pushing event deleted for resources: {'Port': ['ID=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:46.404276 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] No DVR routers for this DVR port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 on host dv-cinder-784623-13-iscsi {{(pid=91645) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:36:46.434385 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.434674 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.435030 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.435379 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.435726 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.436095 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.436439 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.436792 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.437126 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.437464 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.437803 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.438139 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:36:46.444061 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:46.489086 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Calling delete_port for b29eaf10-987b-4e3f-96b8-bb2cc38ba477 owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:46.532977 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.533614 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.538749 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:46.547874 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9c4884cd-a197-48ab-a497-3c07afe55035']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:46.560864 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4626296e-819f-49b9-8f67-944cc7c115da') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:46.561156 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4626296e-819f-49b9-8f67-944cc7c115da') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:46.572975 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.582423 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Pushing event deleted for resources: {'Port': ['ID=b29eaf10-987b-4e3f-96b8-bb2cc38ba477,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:46.586123 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:46.586936 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] No DVR routers for this DVR port b29eaf10-987b-4e3f-96b8-bb2cc38ba477 on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:36:46.593163 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.602078 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Releasing vlan 849 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:36:46.602471 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:36:46.615824 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:36:46.693254 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.697680 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fdfbd835-f53b-43f0-8b7a-d2d8b49df34e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:46.710959 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:46.721846 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Pushing event deleted for resources: {'Network': ['ID=9c4884cd-a197-48ab-a497-3c07afe55035,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:46.728521 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:46.740097 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] 10.222.0.82 "DELETE /v2.0/networks/9c4884cd-a197-48ab-a497-3c07afe55035 HTTP/1.1" status: 204 len: 168 time: 0.8496366 May 20 20:36:46.743374 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44546) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:47.367811 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:47.772753 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Deleting port 97184dad-75cc-4d84-b739-0ac5a43dc683 {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:47.772981 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:47.892570 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] For port 97184dad-75cc-4d84-b739-0ac5a43dc683, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=97184dad-75cc-4d84-b739-0ac5a43dc683,segment=NetworkSegment(f44e922f-ca7d-4170-be3d-efa9bae9e44e),segment_id=f44e922f-ca7d-4170-be3d-efa9bae9e44e)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:47.892924 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:47.938695 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b29eaf10-987b-4e3f-96b8-bb2cc38ba477 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:36:47.972097 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: b29eaf10-987b-4e3f-96b8-bb2cc38ba477 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:36:47.972438 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b29eaf10-987b-4e3f-96b8-bb2cc38ba477 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:36:48.018844 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Calling delete_port for 97184dad-75cc-4d84-b739-0ac5a43dc683 owned by network:router_interface {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:48.164426 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:48.169134 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:48.239732 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Pushing event deleted for resources: {'Port': ['ID=97184dad-75cc-4d84-b739-0ac5a43dc683,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:48.242855 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:48.482186 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:48.923347 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:36:49.094897 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:36:49.103679 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] Sync routers for ids ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:36:49.104638 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] 10.222.0.82 "PUT /v2.0/routers/9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3602090 May 20 20:36:49.107147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44556) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:49.113422 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] Routers {'9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:36:49.114021 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:49.284900 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks [] for router, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:49.291133 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] Set router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:36:49.456964 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:49.531057 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Deleting port 1d502ad2-ac9d-401d-ac74-575c2dae4457 {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:49.531735 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:49.577271 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250'}], 'enable_snat': True}, 'gw_port_id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:36:48Z', 'revision_number': 5, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port': {'id': '1d502ad2-ac9d-401d-ac74-575c2dae4457', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:9e:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:28:35Z', 'updated_at': '2021-05-20T20:28:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:49.581099 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] Checking router: 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:36:49.591022 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] Routers {'9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:36:49.591617 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:49.655778 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.db [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] For port 1d502ad2-ac9d-401d-ac74-575c2dae4457, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=1d502ad2-ac9d-401d-ac74-575c2dae4457,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91645) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:49.656130 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:49.740261 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] Set router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 gateway port host: None {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:36:49.779581 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Calling delete_port for 1d502ad2-ac9d-401d-ac74-575c2dae4457 owned by network:router_gateway {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:49.843576 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:36:49Z', 'revision_number': 6, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:49.847493 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e98d6d7-07a6-40cb-8cba-3433eda800f9 None None] The sync data for ids ['9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0'] in dv-cinder-784623-13-iscsi is: [{'id': '9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0', 'name': 'tempest-TestShelveInstance-1893654432-router', 'tenant_id': '274035bf70724af18a11e7a6e457ed03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:28:34Z', 'updated_at': '2021-05-20T20:36:49Z', 'revision_number': 6, 'project_id': '274035bf70724af18a11e7a6e457ed03', 'gw_port_host': None}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:36:49.914287 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:49.918120 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2790a6ad-fff4-4e06-bb24-0b601d887bb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:49.961878 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Pushing event deleted for resources: {'Port': ['ID=1d502ad2-ac9d-401d-ac74-575c2dae4457,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:49.964261 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:50.052678 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.312583 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 97184dad-75cc-4d84-b739-0ac5a43dc683 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:36:50.341055 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.343244 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.346710 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 97184dad-75cc-4d84-b739-0ac5a43dc683 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:36:50.347182 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 97184dad-75cc-4d84-b739-0ac5a43dc683 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:36:50.366435 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.367095 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 {{(pid=91645) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:36:50.378887 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.380021 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-c2f902ae-53f2-430b-a0b4-7d9a25983925 admin admin] 10.222.0.82 "DELETE /v2.0/routers/9ea2d9ab-b59c-4c5f-bcd1-04dbbf22e5d0 HTTP/1.1" status: 204 len: 168 time: 1.2717628 May 20 20:36:50.383143 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44564) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:50.443960 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_v2 [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Deleting subnet a224f1d0-85ff-4e37-8956-31561c5c3c98 {{(pid=91645) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:36:50.446082 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.497405 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3093741'] for subnet, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.576122 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.830727 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3178326', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4127932'] for subnet, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.834685 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:50.868953 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a224f1d0-85ff-4e37-8956-31561c5c3c98,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:50.871998 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:50.872960 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:50.878383 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61c28659-cca2-405a-b41b-9c01a75b9d94 None None] Network 41de6d5d-bea0-49fe-8865-f88749093770 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:36:50.881770 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/a224f1d0-85ff-4e37-8956-31561c5c3c98 HTTP/1.1" status: 204 len: 168 time: 0.4947140 May 20 20:36:50.882236 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44568) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:50.988152 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.068601 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Deleting port 9ffa3540-d25e-42e9-8392-353cbd248b97 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:51.068913 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.138135 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] DHCP port deletion for 41de6d5d-bea0-49fe-8865-f88749093770 request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:36:51.178615 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] For port 9ffa3540-d25e-42e9-8392-353cbd248b97, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=9ffa3540-d25e-42e9-8392-353cbd248b97,segment=NetworkSegment(f44e922f-ca7d-4170-be3d-efa9bae9e44e),segment_id=f44e922f-ca7d-4170-be3d-efa9bae9e44e)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:51.178979 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.210705 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] Deleting port 9ffa3540-d25e-42e9-8392-353cbd248b97 {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:36:51.211092 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.305288 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Calling delete_port for 9ffa3540-d25e-42e9-8392-353cbd248b97 owned by network:dhcp {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:51.315609 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] For port 9ffa3540-d25e-42e9-8392-353cbd248b97, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=9ffa3540-d25e-42e9-8392-353cbd248b97,segment=NetworkSegment(f44e922f-ca7d-4170-be3d-efa9bae9e44e),segment_id=f44e922f-ca7d-4170-be3d-efa9bae9e44e)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:36:51.316170 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.352059 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.355934 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6799e067-434b-4fd6-a5cb-1a7c8848dc8c tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:51.404211 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] No DVR routers for this DVR port 9ffa3540-d25e-42e9-8392-353cbd248b97 on host dv-cinder-784623-13-iscsi {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:36:51.428951 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Pushing event deleted for resources: {'Port': ['ID=9ffa3540-d25e-42e9-8392-353cbd248b97,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:51.431327 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:51.436637 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] Calling delete_port for 9ffa3540-d25e-42e9-8392-353cbd248b97 owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:36:51.484269 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.494497 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:51.523408 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.537491 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41de6d5d-bea0-49fe-8865-f88749093770']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:51.550738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f44e922f-ca7d-4170-be3d-efa9bae9e44e') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:51.551108 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f44e922f-ca7d-4170-be3d-efa9bae9e44e') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:36:51.564201 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.578608 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] No DVR routers for this DVR port 9ffa3540-d25e-42e9-8392-353cbd248b97 on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:36:51.580257 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] Pushing event deleted for resources: {'Port': ['ID=9ffa3540-d25e-42e9-8392-353cbd248b97,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:51.584732 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.585359 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-351ac112-eee6-4b1c-ae62-1355d9f5cd0f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:51.594322 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Releasing vlan 805 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:36:51.594733 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:36:51.608088 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:36:51.685517 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.689423 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-544d384b-3586-4e1d-9553-f1a5382f79b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:51.702742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.713471 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Pushing event deleted for resources: {'Network': ['ID=41de6d5d-bea0-49fe-8865-f88749093770,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:51.716660 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] 10.222.0.82 "DELETE /v2.0/networks/41de6d5d-bea0-49fe-8865-f88749093770 HTTP/1.1" status: 204 len: 168 time: 0.8333583 May 20 20:36:51.719414 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:51.834402 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44580) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:51.883582 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ac054de4-240b-449f-a2c0-cbea2d25127d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bf9ff50b3c4f4f7e8afcf9c87cade238&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0478551 May 20 20:36:51.886032 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44584) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:51.945543 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 9ffa3540-d25e-42e9-8392-353cbd248b97 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:36:51.948298 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.973768 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:51.980214 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 9ffa3540-d25e-42e9-8392-353cbd248b97 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:36:51.980639 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 9ffa3540-d25e-42e9-8392-353cbd248b97 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:36:51.981226 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1d502ad2-ac9d-401d-ac74-575c2dae4457 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:36:52.015459 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 1d502ad2-ac9d-401d-ac74-575c2dae4457 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:36:52.015910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 1d502ad2-ac9d-401d-ac74-575c2dae4457 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:36:52.041733 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:52.046940 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c6a53d98-5e13-46db-84ef-0aa78912fcc5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:52.061412 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0786391d-607b-4366-9ff1-7f12a0b96e13,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:52.064834 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:52.068216 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:52.069469 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0786391d-607b-4366-9ff1-7f12a0b96e13 HTTP/1.1" status: 204 len: 168 time: 0.1825001 May 20 20:36:52.436931 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44602) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:52.490179 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-57c4a7e8-f89b-4469-8707-6b69e15fd98d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=274035bf70724af18a11e7a6e457ed03&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0518911 May 20 20:36:52.493365 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44606) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:36:52.557233 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:52.582929 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:52.636869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:52.640498 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5dac4852-8fcd-4a5a-89db-e04477435f82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:36:52.652038 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4d83034-90d9-4869-aa4c-b04fefeb3d0b,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:36:52.655409 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:36:52.658743 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:36:52.659817 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e4d83034-90d9-4869-aa4c-b04fefeb3d0b HTTP/1.1" status: 204 len: 168 time: 0.1654820 May 20 20:36:56.946186 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fc1529-4103-4cab-9307-dc0c289d7b00 req-8a104bef-09e8-41aa-8505-70d769cac2ed tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:56.947548 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-29fc1529-4103-4cab-9307-dc0c289d7b00 req-8a104bef-09e8-41aa-8505-70d769cac2ed tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0798864 May 20 20:36:56.996145 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-29fc1529-4103-4cab-9307-dc0c289d7b00 req-0eba68b2-cf30-49da-958c-4e560e5c73ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428283 May 20 20:36:58.183915 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe6edf7-538d-4788-bee9-ae2942dc068d req-66b3416f-d79d-4774-8aad-a5ee077b32d4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:58.185403 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4fe6edf7-538d-4788-bee9-ae2942dc068d req-66b3416f-d79d-4774-8aad-a5ee077b32d4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0830581 May 20 20:36:58.230630 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4fe6edf7-538d-4788-bee9-ae2942dc068d req-33009743-2ce0-44c9-acc1-a00307709505 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395243 May 20 20:36:59.417266 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-356d1879-c670-44c6-8f4d-c341d6dae23a req-ef94092e-1532-4a53-bc21-631bd0df8d5d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:59.419108 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-356d1879-c670-44c6-8f4d-c341d6dae23a req-ef94092e-1532-4a53-bc21-631bd0df8d5d tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0790205 May 20 20:36:59.463033 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-356d1879-c670-44c6-8f4d-c341d6dae23a req-2ff49a81-e2e3-4fce-8130-69d01197f6e0 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381076 May 20 20:36:59.821302 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-6265b1cd-1af1-4f76-8891-876ababb2233 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:36:59.822604 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-6265b1cd-1af1-4f76-8891-876ababb2233 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 945 time: 0.0828860 May 20 20:37:00.050977 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Deleting port 2abde94a-966c-4288-b8cb-201a164e69b0 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:00.051314 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:00.184863 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] For port 2abde94a-966c-4288-b8cb-201a164e69b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=2abde94a-966c-4288-b8cb-201a164e69b0,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:00.185211 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:00.473352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:00.473704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:00.474003 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Floating IP a4805426-4e85-42a9-b3aa-15dad628ae73 disassociated. External IP: 172.27.3.209, port: 2abde94a-966c-4288-b8cb-201a164e69b0. May 20 20:37:00.474329 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Calling delete_port for 2abde94a-966c-4288-b8cb-201a164e69b0 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:00.626175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:00.631507 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cddef9be-861e-4ced-b587-d0bbeb39e93d tempest-AttachVolumeNegativeTest-628280678 tempest-AttachVolumeNegativeTest-628280678-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:00.683669 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event deleted for resources: {'Port': ['ID=2abde94a-966c-4288-b8cb-201a164e69b0,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:00.689994 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:00.841891 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c74a0f4-f2bd-4771-bbf6-a2f917dadef3 req-34ccffb9-6405-4806-8308-a677057adfbe tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:00.843228 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3c74a0f4-f2bd-4771-bbf6-a2f917dadef3 req-34ccffb9-6405-4806-8308-a677057adfbe tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b857e31-f11e-4da9-aacf-e024e3379c95 HTTP/1.1" status: 200 len: 867 time: 0.2674444 May 20 20:37:00.912872 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-3c74a0f4-f2bd-4771-bbf6-a2f917dadef3 req-5b95d782-dc2b-416e-90c6-33a0e24aeeb2 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups?id=6f877e06-701c-43c3-98f7-91a4026f2219&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621839 May 20 20:37:00.914775 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:37:01.095823 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:37:01.105645 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] Sync routers for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:37:01.119386 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:01.120134 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:01.168418 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] No DVR routers for this DVR port 2abde94a-966c-4288-b8cb-201a164e69b0 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:37:01.170905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:01.173474 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'name': 'network-vif-deleted', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:37:01.189173 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6f0143ee-67a6-4cc2-9eb6-9eae52df9bf2 req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.69 "DELETE /v2.0/ports/2abde94a-966c-4288-b8cb-201a164e69b0 HTTP/1.1" status: 204 len: 173 time: 1.3595212 May 20 20:37:01.223805 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b857e31-f11e-4da9-aacf-e024e3379c95', 'name': 'network-vif-deleted', 'tag': '2abde94a-966c-4288-b8cb-201a164e69b0', 'status': 'completed', 'code': 200} May 20 20:37:01.311385 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:01.621105 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:01.624843 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] Checking router: e666c92f-d3d0-46f1-aeb9-c3dd182bf186 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:37:01.633029 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:01.633610 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:36:37Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:01.812385 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:02.040827 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44654) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:02.109506 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.138680 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.142666 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:02.146841 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e87d8ca-48c6-4375-ba59-c30d548c6a4b None None] The sync data for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi is: [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:27:19Z', 'revision_number': 4, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '181874e7-6fac-4648-9d3e-ed7f7c298702', 'name': '', 'network_id': '16b76e5b-322b-4d3c-b8d3-2d6888efd464', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'mac_address': 'fa:16:3e:b5:5c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:31Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'subnets': [{'id': '0f0b1ce3-e7c0-4e40-a18c-07e082124ea7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:37:02.200250 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.204187 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e14955ba-c28b-457c-8f19-b09f0bb13f30 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:02.221409 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f877e06-701c-43c3-98f7-91a4026f2219,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:02.224124 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:02.238421 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.240116 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "DELETE /v2.0/security-groups/6f877e06-701c-43c3-98f7-91a4026f2219 HTTP/1.1" status: 204 len: 168 time: 0.1981058 May 20 20:37:02.243152 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44658) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:02.260229 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.api.v2.resource [None req-bf795a8f-975b-4295-af0a-90451cdd65c8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] show failed (client error): The resource could not be found. May 20 20:37:02.261253 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-bf795a8f-975b-4295-af0a-90451cdd65c8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "GET /v2.0/security-groups/6f877e06-701c-43c3-98f7-91a4026f2219 HTTP/1.1" status: 404 len: 347 time: 0.0172112 May 20 20:37:02.264073 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44662) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:02.373312 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08ad37f7-367d-41a9-a1c7-8b20cf7ab1b8 None None] New status for floating IP a4805426-4e85-42a9-b3aa-15dad628ae73: DOWN {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:37:02.486839 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Deleting port 2bc1f9fb-96f9-4a5f-827b-8cae8aa8a03f {{(pid=91645) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:02.487069 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.706631 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.706959 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.827314 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.plugin [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Calling delete_port for 2bc1f9fb-96f9-4a5f-827b-8cae8aa8a03f owned by network:floatingip {{(pid=91645) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:02.933526 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:02.937080 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-86aaeb1e-d9f7-4cac-8bfd-d1b5d220fb69 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:02.983338 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Pushing event deleted for resources: {'Port': ['ID=2bc1f9fb-96f9-4a5f-827b-8cae8aa8a03f,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:02.985863 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:03.076237 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks [] for floatingip, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:03.090200 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:03.091253 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8ccb2cb4-1a69-481e-9509-f86a0adeb0db tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] 10.222.0.82 "DELETE /v2.0/floatingips/a4805426-4e85-42a9-b3aa-15dad628ae73 HTTP/1.1" status: 204 len: 168 time: 0.8262939 May 20 20:37:03.794778 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 2abde94a-966c-4288-b8cb-201a164e69b0 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:03.833216 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 2abde94a-966c-4288-b8cb-201a164e69b0 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:03.833568 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 2abde94a-966c-4288-b8cb-201a164e69b0 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:04.769450 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d8a7e97c-316a-4e81-9a8a-46f3ca3baf14 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:07.078512 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44694) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:07.221641 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:07.498607 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-57208ac8-dc38-451b-bfa0-77205f7b3c39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:07.916958 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:08.311916 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:08.317797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Deleting port 181874e7-6fac-4648-9d3e-ed7f7c298702 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:08.318204 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:08.441171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] For port 181874e7-6fac-4648-9d3e-ed7f7c298702, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=181874e7-6fac-4648-9d3e-ed7f7c298702,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:08.441518 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:08.564736 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Calling delete_port for 181874e7-6fac-4648-9d3e-ed7f7c298702 owned by network:router_interface {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:08.715600 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:08.719960 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-040682c6-3b8b-4b79-a4c4-39c1ce84d3fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:08.793671 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Pushing event deleted for resources: {'Port': ['ID=181874e7-6fac-4648-9d3e-ed7f7c298702,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:08.796195 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:09.133106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:09.495754 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:37:09.670453 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:37:09.679898 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] Sync routers for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:37:09.684250 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] 10.222.0.82 "PUT /v2.0/routers/e666c92f-d3d0-46f1-aeb9-c3dd182bf186/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6046557 May 20 20:37:09.686704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44700) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:09.689196 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:09.689816 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:37:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:09.865857 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks [] for router, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:09.927736 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:09.969149 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.045310 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.118148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Deleting port bbd1b22b-25f8-403b-9c74-e0f14c802c25 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:10.118394 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.208220 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:37:08Z', 'revision_number': 5, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port': {'id': 'bbd1b22b-25f8-403b-9c74-e0f14c802c25', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:3b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:09Z', 'updated_at': '2021-05-20T20:27:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:10.213048 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] Checking router: e666c92f-d3d0-46f1-aeb9-c3dd182bf186 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:37:10.221411 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] Routers {'e666c92f-d3d0-46f1-aeb9-c3dd182bf186'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:10.222010 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:37:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:10.245155 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] For port bbd1b22b-25f8-403b-9c74-e0f14c802c25, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=bbd1b22b-25f8-403b-9c74-e0f14c802c25,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:10.245507 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.374988 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] Set router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 gateway port host: None {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:10.474338 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Calling delete_port for bbd1b22b-25f8-403b-9c74-e0f14c802c25 owned by network:router_gateway {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:10.480564 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:37:10Z', 'revision_number': 6, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:10.484477 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42b64d7-1a73-4e7f-ab4d-4f065af12aaf None None] The sync data for ids ['e666c92f-d3d0-46f1-aeb9-c3dd182bf186'] in dv-cinder-784623-13-iscsi is: [{'id': 'e666c92f-d3d0-46f1-aeb9-c3dd182bf186', 'name': 'tempest-AttachVolumeTestJSON-238141999-router', 'tenant_id': '831701ab26e241d0ac004d15e3ea0632', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:08Z', 'updated_at': '2021-05-20T20:37:10Z', 'revision_number': 6, 'project_id': '831701ab26e241d0ac004d15e3ea0632', 'gw_port_host': None}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:37:10.614183 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.619032 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a9ea486d-6e8a-46b9-ab2e-0c5f05134904 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:10.660507 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Pushing event deleted for resources: {'Port': ['ID=bbd1b22b-25f8-403b-9c74-e0f14c802c25,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:10.686145 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:10.750643 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.922160 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.924514 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.953843 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.954419 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e666c92f-d3d0-46f1-aeb9-c3dd182bf186 {{(pid=91646) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:37:10.967800 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:10.968903 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] 10.222.0.82 "DELETE /v2.0/routers/e666c92f-d3d0-46f1-aeb9-c3dd182bf186 HTTP/1.1" status: 204 len: 168 time: 1.2813199 May 20 20:37:10.971339 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44704) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:11.029147 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Deleting subnet 0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:37:11.032025 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.081945 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.157345 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.407438 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.411229 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-72cafe98-9a7d-4660-81b9-624d56412826 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:11.448944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0f0b1ce3-e7c0-4e40-a18c-07e082124ea7,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:11.450906 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.453730 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:11.458018 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/0f0b1ce3-e7c0-4e40-a18c-07e082124ea7 HTTP/1.1" status: 204 len: 168 time: 0.4857018 May 20 20:37:11.458920 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88d845bc-44f3-428e-a7cc-0b086c0779d2 None None] Network 16b76e5b-322b-4d3c-b8d3-2d6888efd464 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:37:11.460539 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44708) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:11.571559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.641276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Deleting port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:11.641992 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.716472 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] DHCP port deletion for 16b76e5b-322b-4d3c-b8d3-2d6888efd464 request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:37:11.745970 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] For port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:11.746241 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.783592 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Deleting port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:11.784016 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.869203 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Calling delete_port for 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 owned by network:dhcp {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:11.880259 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] For port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,segment=NetworkSegment(d1427bab-94d8-4746-a3e3-cb687a069788),segment_id=d1427bab-94d8-4746-a3e3-cb687a069788)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:11.880653 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.941353 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:11.946978 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:11.990682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Pushing event deleted for resources: {'Port': ['ID=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:11.993790 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:11.994589 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] No DVR routers for this DVR port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 on host dv-cinder-784623-13-iscsi {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:37:12.042097 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 181874e7-6fac-4648-9d3e-ed7f7c298702 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:12.076815 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Calling delete_port for 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:12.088001 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 181874e7-6fac-4648-9d3e-ed7f7c298702 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:12.088350 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 181874e7-6fac-4648-9d3e-ed7f7c298702 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:12.088779 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:12.125232 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:12.125578 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:12.126011 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bbd1b22b-25f8-403b-9c74-e0f14c802c25 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:12.205500 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.214308 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: bbd1b22b-25f8-403b-9c74-e0f14c802c25 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:12.214655 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device bbd1b22b-25f8-403b-9c74-e0f14c802c25 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:12.219564 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16b76e5b-322b-4d3c-b8d3-2d6888efd464']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:12.233597 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd1427bab-94d8-4746-a3e3-cb687a069788') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:12.233838 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd1427bab-94d8-4746-a3e3-cb687a069788') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:12.245956 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.248719 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.252284 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-4f700bad-352a-40ca-828b-a8fa457703d4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:12.262101 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.268052 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Releasing vlan 843 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:37:12.268426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:37:12.281282 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:37:12.294852 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Pushing event deleted for resources: {'Port': ['ID=4d1d3fe6-a8d3-47d5-8a34-401e0920e835,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:12.296643 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] No DVR routers for this DVR port 4d1d3fe6-a8d3-47d5-8a34-401e0920e835 on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:37:12.298081 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:12.360449 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.363995 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:12.377294 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.388688 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Pushing event deleted for resources: {'Network': ['ID=16b76e5b-322b-4d3c-b8d3-2d6888efd464,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:12.392986 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:12.402049 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] 10.222.0.82 "DELETE /v2.0/networks/16b76e5b-322b-4d3c-b8d3-2d6888efd464 HTTP/1.1" status: 204 len: 168 time: 0.9404962 May 20 20:37:12.534365 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44716) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:12.582619 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d26598f3-fd25-46ae-9146-3e841201f72f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=831701ab26e241d0ac004d15e3ea0632&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0468554 May 20 20:37:12.585705 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44720) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:12.644142 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-626fd064-01b3-4739-bc7b-3644c80ffd08 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.670803 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-626fd064-01b3-4739-bc7b-3644c80ffd08 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.722632 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-626fd064-01b3-4739-bc7b-3644c80ffd08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.726999 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-859867b7-ab5d-4dda-bfaf-9843d1c34a5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:12.740618 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626fd064-01b3-4739-bc7b-3644c80ffd08 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=363bf234-ee18-49c0-afa7-bd1ec85ff1e8,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:12.744550 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-626fd064-01b3-4739-bc7b-3644c80ffd08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:12.747782 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-626fd064-01b3-4739-bc7b-3644c80ffd08 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:12.751234 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-626fd064-01b3-4739-bc7b-3644c80ffd08 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/363bf234-ee18-49c0-afa7-bd1ec85ff1e8 HTTP/1.1" status: 204 len: 168 time: 0.1621208 May 20 20:37:14.008232 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df941b71-9e6d-4024-bb6b-a28675204f4e req-a4442a77-8967-4a74-a16a-a3621ee0c5ff tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:14.009942 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-df941b71-9e6d-4024-bb6b-a28675204f4e req-a4442a77-8967-4a74-a16a-a3621ee0c5ff tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 947 time: 0.2824554 May 20 20:37:14.058108 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-df941b71-9e6d-4024-bb6b-a28675204f4e req-22a909e1-11bb-4063-8b3e-a22d3daeb993 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424182 May 20 20:37:15.078701 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:15.320380 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673ef671-da57-49d1-999f-473f5c86b1f1 req-7cdabb52-a173-4754-a562-a24f6f433584 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:15.321887 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-673ef671-da57-49d1-999f-473f5c86b1f1 req-7cdabb52-a173-4754-a562-a24f6f433584 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 947 time: 0.1489842 May 20 20:37:15.376098 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-673ef671-da57-49d1-999f-473f5c86b1f1 req-598b3207-9616-4fe9-b5f1-2ee3b70bf993 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484107 May 20 20:37:16.146784 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-5e5a5be9-82ca-477a-b365-829184265d59 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:16.148918 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-5e5a5be9-82ca-477a-b365-829184265d59 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 947 time: 0.0783441 May 20 20:37:16.288338 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Deleting port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:16.288653 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:16.419251 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] For port 5c067b29-7c3f-4485-a9cb-8822d9b39a76, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=5c067b29-7c3f-4485-a9cb-8822d9b39a76,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:16.419829 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:16.577290 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a53de4e-c23f-42fd-8b3d-d730c2011c18 req-1d3b3e3e-9365-463a-8473-c464fa0fb9ec tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:16.578744 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a53de4e-c23f-42fd-8b3d-d730c2011c18 req-1d3b3e3e-9365-463a-8473-c464fa0fb9ec tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 947 time: 0.0795333 May 20 20:37:16.625759 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3a53de4e-c23f-42fd-8b3d-d730c2011c18 req-73db2f8e-8ef9-4e27-bc2f-0faf5c69aad1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups?id=10c3893a-57c7-4733-9ee1-08e1c9a8bd72&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409887 May 20 20:37:16.708992 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:16.709363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:16.709694 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Floating IP 5a691d52-5dbe-4ea9-bf40-5c0720e43a2d disassociated. External IP: 172.27.3.48, port: 5c067b29-7c3f-4485-a9cb-8822d9b39a76. May 20 20:37:16.710491 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Calling delete_port for 5c067b29-7c3f-4485-a9cb-8822d9b39a76 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:16.824154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:16.829699 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a8d991f9-41ff-4fdc-9a8e-1d5b00c5d7b7 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:16.878881 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event deleted for resources: {'Port': ['ID=5c067b29-7c3f-4485-a9cb-8822d9b39a76,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:16.882701 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:17.063324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Router cdb694ee-b9bf-4ffe-895b-e76ca953be5d has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:37:17.352926 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:37:17.364800 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] Sync routers for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:37:17.375325 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:17.375987 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:37:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:17.432735 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] No DVR routers for this DVR port 5c067b29-7c3f-4485-a9cb-8822d9b39a76 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:37:17.435264 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:17.438431 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-deleted', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:37:17.456246 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a92fb3d7-95f8-4a21-9989-3d594f75f4c2 req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.69 "DELETE /v2.0/ports/5c067b29-7c3f-4485-a9cb-8822d9b39a76 HTTP/1.1" status: 204 len: 173 time: 1.2981014 May 20 20:37:17.489553 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '752aab2d-e84c-40e9-9518-5a7a71776443', 'name': 'network-vif-deleted', 'tag': '5c067b29-7c3f-4485-a9cb-8822d9b39a76', 'status': 'completed', 'code': 200} May 20 20:37:17.564965 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:17.796973 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-c5cdf258-20b1-49f8-a94c-964c3d9fb4e7 req-0a5d4fdf-0a63-4192-8ca7-bc615caec92d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Synchronizing usage tracker for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:37:17.812562 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:37:17.813344 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-c5cdf258-20b1-49f8-a94c-964c3d9fb4e7 req-0a5d4fdf-0a63-4192-8ca7-bc615caec92d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Unset dirty status for tenant:d5d038c87b86437990c22a9e55b308b6 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:37:17.814663 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c5cdf258-20b1-49f8-a94c-964c3d9fb4e7 req-0a5d4fdf-0a63-4192-8ca7-bc615caec92d tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/ports?device_id=752aab2d-e84c-40e9-9518-5a7a71776443 HTTP/1.1" status: 200 len: 210 time: 0.0593371 May 20 20:37:17.889989 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:17.893808 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] Checking router: cdb694ee-b9bf-4ffe-895b-e76ca953be5d for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:37:17.903136 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:17.903724 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:37:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:18.084732 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:18.403563 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:18.407553 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecffa821-062b-498b-aa7d-fef5360e10bf None None] The sync data for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi is: [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:27:18Z', 'revision_number': 4, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '07986231-dfc0-427e-81fe-e80e576bf2aa', 'name': '', 'network_id': '5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'mac_address': 'fa:16:3e:05:0d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:17Z', 'updated_at': '2021-05-20T20:27:32Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'subnets': [{'id': '113ead2b-c65c-4cf9-b6ed-724ff34a0db1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:37:18.624185 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-287db8b0-fe1c-45b7-96f7-2f0d30e0dba6 None None] New status for floating IP 5a691d52-5dbe-4ea9-bf40-5c0720e43a2d: DOWN {{(pid=91647) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:37:18.952583 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44828) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:19.019293 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.048048 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.107649 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.111429 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4e093f8f-9bda-454c-aa5b-9c98e02a21c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:19.127041 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=10c3893a-57c7-4733-9ee1-08e1c9a8bd72,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:19.129596 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:19.138329 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.139699 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "DELETE /v2.0/security-groups/10c3893a-57c7-4733-9ee1-08e1c9a8bd72 HTTP/1.1" status: 204 len: 168 time: 0.1858885 May 20 20:37:19.143880 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44840) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:19.161634 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.api.v2.resource [None req-aed0d70d-47bb-4250-a771-ac5af68fbbcb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] show failed (client error): The resource could not be found. May 20 20:37:19.162744 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-aed0d70d-47bb-4250-a771-ac5af68fbbcb tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "GET /v2.0/security-groups/10c3893a-57c7-4733-9ee1-08e1c9a8bd72 HTTP/1.1" status: 404 len: 347 time: 0.0176189 May 20 20:37:19.165759 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44844) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:19.401172 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Deleting port 37b4b970-471b-495e-a080-a26eb390c2b6 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:19.401510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.523430 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.523751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.645245 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Calling delete_port for 37b4b970-471b-495e-a080-a26eb390c2b6 owned by network:floatingip {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:19.753785 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.758830 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-128c4d0c-dd5b-4301-b9c8-87d9f5829979 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:19.810458 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Pushing event deleted for resources: {'Port': ['ID=37b4b970-471b-495e-a080-a26eb390c2b6,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:19.835594 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:19.897527 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks [] for floatingip, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.905165 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:19.916187 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:19.917417 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] 10.222.0.82 "DELETE /v2.0/floatingips/5a691d52-5dbe-4ea9-bf40-5c0720e43a2d HTTP/1.1" status: 204 len: 168 time: 0.7507648 May 20 20:37:19.945020 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 5c067b29-7c3f-4485-a9cb-8822d9b39a76 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:19.945262 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 5c067b29-7c3f-4485-a9cb-8822d9b39a76 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:22.696146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44888) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:23.181566 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44900) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:23.310092 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.324200 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:23.327919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Usage tracker for resource:security_group_rule and tenant:f25e64b763804b308db826f8f3d0b1c9 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:23.330695 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:23.336517 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:23.421439 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.425481 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.435037 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-1ad5d3f2-ad0d-4909-a23a-2612217b2b31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:23.445498 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.477823 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f25e64b763804b308db826f8f3d0b1c9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2944832 May 20 20:37:23.479562 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97ad2d47-c0c7-44e8-819a-1b585bdc8b43,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:23.482586 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-11688ab4-c8d7-4c08-8fcf-5580df62ab40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:23.483218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44906) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:23.542274 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.569096 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.624198 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.627902 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-28e1fae4-a32d-49aa-8658-ee5ab55ae3e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:23.638960 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97ad2d47-c0c7-44e8-819a-1b585bdc8b43,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:23.641215 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:23.646963 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.651138 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/97ad2d47-c0c7-44e8-819a-1b585bdc8b43 HTTP/1.1" status: 204 len: 168 time: 0.1640635 May 20 20:37:23.869752 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Deleting port 07986231-dfc0-427e-81fe-e80e576bf2aa {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:23.870230 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:23.994936 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] For port 07986231-dfc0-427e-81fe-e80e576bf2aa, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=07986231-dfc0-427e-81fe-e80e576bf2aa,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:23.995340 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:24.119046 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Calling delete_port for 07986231-dfc0-427e-81fe-e80e576bf2aa owned by network:router_interface {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:24.278111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:24.282932 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-eadf51dd-4acf-406d-9a55-dec168b19b1f tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:24.325581 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Pushing event deleted for resources: {'Port': ['ID=07986231-dfc0-427e-81fe-e80e576bf2aa,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:24.328724 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:24.604619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.072706 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Router cdb694ee-b9bf-4ffe-895b-e76ca953be5d has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:37:25.254296 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:37:25.266553 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] Sync routers for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:37:25.267304 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] 10.222.0.82 "PUT /v2.0/routers/cdb694ee-b9bf-4ffe-895b-e76ca953be5d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5696683 May 20 20:37:25.269753 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44950) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:25.279525 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:25.280234 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:37:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:25.376624 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44956) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:25.449466 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks [] for router, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.460812 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:25.501982 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.516964 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:25.520812 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Usage tracker for resource:security_group_rule and tenant:079cc155c7004be5ac5153b6bd71f234 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:25.524450 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:25.531330 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:25.621906 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.627301 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.635486 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.636877 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-24acdce6-b900-40f6-b9a4-c14f271cb088 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:25.679248 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=079cc155c7004be5ac5153b6bd71f234&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2991419 May 20 20:37:25.679791 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a831bfa-c9ad-4ac3-bb4d-f862514a8658,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:25.682882 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44962) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:25.685196 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e5179b35-e156-470a-b3bb-869fcd2a7e49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:25.721553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Deleting port 63c29677-de58-48bf-90f2-b11cdbd2fe54 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:25.721786 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.743720 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.776131 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.796272 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:37:24Z', 'revision_number': 5, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port': {'id': '63c29677-de58-48bf-90f2-b11cdbd2fe54', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:6c:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:27:11Z', 'updated_at': '2021-05-20T20:27:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:25.800009 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] Checking router: cdb694ee-b9bf-4ffe-895b-e76ca953be5d for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:37:25.809090 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] Routers {'cdb694ee-b9bf-4ffe-895b-e76ca953be5d'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:37:25.809710 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:37:07Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:25.843313 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.848835 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c7a7222c-f4ee-4676-87e3-8ccff2d1e060 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:25.852407 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] For port 63c29677-de58-48bf-90f2-b11cdbd2fe54, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=63c29677-de58-48bf-90f2-b11cdbd2fe54,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:25.852770 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.859797 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a831bfa-c9ad-4ac3-bb4d-f862514a8658,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:25.865774 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:25.866647 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:25.868338 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2a831bfa-c9ad-4ac3-bb4d-f862514a8658 HTTP/1.1" status: 204 len: 168 time: 0.1842048 May 20 20:37:25.983888 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Calling delete_port for 63c29677-de58-48bf-90f2-b11cdbd2fe54 owned by network:router_gateway {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:25.996901 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] Set router cdb694ee-b9bf-4ffe-895b-e76ca953be5d gateway port host: None {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:37:26.108823 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:37:25Z', 'revision_number': 6, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:26.112885 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bdea433-5079-4e87-b301-176462eac9ae None None] The sync data for ids ['cdb694ee-b9bf-4ffe-895b-e76ca953be5d'] in dv-cinder-784623-13-iscsi is: [{'id': 'cdb694ee-b9bf-4ffe-895b-e76ca953be5d', 'name': 'tempest-AttachVolumeShelveTestJSON-2003857384-router', 'tenant_id': 'd5d038c87b86437990c22a9e55b308b6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:27:10Z', 'updated_at': '2021-05-20T20:37:25Z', 'revision_number': 6, 'project_id': 'd5d038c87b86437990c22a9e55b308b6', 'gw_port_host': None}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:37:26.136819 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.141903 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:26.187705 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Pushing event deleted for resources: {'Port': ['ID=63c29677-de58-48bf-90f2-b11cdbd2fe54,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:26.199324 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44970) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:26.217339 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.222589 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:26.233949 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:26.238108 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Usage tracker for resource:security_group_rule and tenant:b0ae3ec1f6104593acce9b0c5f5c134f is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:26.241174 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:26.247848 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:26.339441 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.344318 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.352884 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5c37caae-1c3f-4801-b538-e3139f48d694 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:26.391608 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b0ae3ec1f6104593acce9b0c5f5c134f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1910629 May 20 20:37:26.393242 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad47cea8-4c50-4980-b6fd-9371fb407366,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:26.393642 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.395466 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 44974) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:26.398109 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-19d1d2a7-9fb8-44e8-8363-0dc7d9c06ca9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:26.463350 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.492056 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.554097 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.558243 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9a5479d7-e79f-424b-bf2f-8a6c60d822ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:26.568983 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad47cea8-4c50-4980-b6fd-9371fb407366,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:26.574461 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:26.576571 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.578112 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.578545 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.581819 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ad47cea8-4c50-4980-b6fd-9371fb407366 HTTP/1.1" status: 204 len: 168 time: 0.1830032 May 20 20:37:26.606036 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.606563 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Fanout notify agent at l3_agent the message router_deleted on router cdb694ee-b9bf-4ffe-895b-e76ca953be5d {{(pid=91646) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:37:26.618614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.619741 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] 10.222.0.82 "DELETE /v2.0/routers/cdb694ee-b9bf-4ffe-895b-e76ca953be5d HTTP/1.1" status: 204 len: 168 time: 1.3488495 May 20 20:37:26.622198 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44980) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:26.689604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Deleting subnet 113ead2b-c65c-4cf9-b6ed-724ff34a0db1 {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:37:26.692957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.744040 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:26.824072 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.089455 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.100481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:27.132137 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.140663 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41999b4f-1a58-4150-8870-ab568678da60 None None] Network 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:37:27.144771 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=113ead2b-c65c-4cf9-b6ed-724ff34a0db1,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:27.146662 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:27.149164 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-162cf310-b78c-4d8b-9e74-d0987197b877 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/113ead2b-c65c-4cf9-b6ed-724ff34a0db1 HTTP/1.1" status: 204 len: 168 time: 0.5254445 May 20 20:37:27.151167 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 44998) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:27.272777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.359483 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Deleting port b55941a7-4e87-49e6-a7d6-98160936fa17 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:27.360168 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.435908 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] DHCP port deletion for 5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:37:27.479553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] For port b55941a7-4e87-49e6-a7d6-98160936fa17, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b55941a7-4e87-49e6-a7d6-98160936fa17,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:27.480184 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.551246 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Deleting port b55941a7-4e87-49e6-a7d6-98160936fa17 {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:37:27.551885 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.654503 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Calling delete_port for b55941a7-4e87-49e6-a7d6-98160936fa17 owned by network:dhcp {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:27.668973 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] For port b55941a7-4e87-49e6-a7d6-98160936fa17, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=b55941a7-4e87-49e6-a7d6-98160936fa17,segment=NetworkSegment(1e05f149-338e-4199-8c1b-ffbf3489ad6c),segment_id=1e05f149-338e-4199-8c1b-ffbf3489ad6c)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:37:27.669361 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.715226 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.720364 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d161e365-222a-47d9-a647-ecd0b19662d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:27.768174 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Pushing event deleted for resources: {'Port': ['ID=b55941a7-4e87-49e6-a7d6-98160936fa17,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:27.770512 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:27.771434 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] No DVR routers for this DVR port b55941a7-4e87-49e6-a7d6-98160936fa17 on host dv-cinder-784623-13-iscsi {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:37:27.793067 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Calling delete_port for b55941a7-4e87-49e6-a7d6-98160936fa17 owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:37:27.837001 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.841882 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:27.890910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Pushing event deleted for resources: {'Port': ['ID=b55941a7-4e87-49e6-a7d6-98160936fa17,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:27.891037 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.892830 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.893242 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.893669 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.894086 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.894501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.894994 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.895571 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.896002 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.896409 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.896812 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.897215 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.897611 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:27.901150 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] No DVR routers for this DVR port b55941a7-4e87-49e6-a7d6-98160936fa17 on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:37:27.902722 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-65b33d32-b16d-40cd-bbea-392d6b7d000c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:27.906564 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:27.924737 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1e05f149-338e-4199-8c1b-ffbf3489ad6c') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:27.924960 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1e05f149-338e-4199-8c1b-ffbf3489ad6c') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:27.937738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.962660 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.970131 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Releasing vlan 840 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:37:27.970755 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:27.976468 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 07986231-dfc0-427e-81fe-e80e576bf2aa no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:28.014378 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 07986231-dfc0-427e-81fe-e80e576bf2aa {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:28.015044 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 07986231-dfc0-427e-81fe-e80e576bf2aa not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:28.015630 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 63c29677-de58-48bf-90f2-b11cdbd2fe54 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:28.053703 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 63c29677-de58-48bf-90f2-b11cdbd2fe54 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:28.054053 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 63c29677-de58-48bf-90f2-b11cdbd2fe54 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:28.054484 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b55941a7-4e87-49e6-a7d6-98160936fa17 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:37:28.089098 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: b55941a7-4e87-49e6-a7d6-98160936fa17 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:37:28.089448 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device b55941a7-4e87-49e6-a7d6-98160936fa17 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:37:28.104609 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:37:28.166433 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.170178 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:28.183719 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.199486 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Pushing event deleted for resources: {'Network': ['ID=5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:28.206027 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:28.213495 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] 10.222.0.82 "DELETE /v2.0/networks/5d32c07a-6d0f-4ca7-84cd-47a5b8f0a528 HTTP/1.1" status: 204 len: 168 time: 1.0611773 May 20 20:37:28.418988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45032) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:28.468337 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d5185c8d-3a06-4569-8118-59d7e5251998 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d5d038c87b86437990c22a9e55b308b6&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0480745 May 20 20:37:28.470666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45036) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:28.501744 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45040) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:28.530965 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.558664 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.611811 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.616632 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-62995eb9-d3c3-480d-8fdf-1fae420616fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:28.622676 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.629988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1656c000-f292-4784-b09b-8e0b25b624d2,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:28.633907 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:28.637483 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:28.637620 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.641340 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1656c000-f292-4784-b09b-8e0b25b624d2 HTTP/1.1" status: 204 len: 168 time: 0.1697266 May 20 20:37:28.641719 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Usage tracker for resource:security_group_rule and tenant:6ef00cfce78141098277fba81a601c32 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:28.644681 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:28.651029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:28.735696 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.739976 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.747736 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a572f123-2828-4fe6-9145-1efce15d14ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:28.792008 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6ef00cfce78141098277fba81a601c32&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2891388 May 20 20:37:28.793272 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9aec4ddc-743a-4827-b2c3-63015be829fd,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:28.794983 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45050) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:28.796304 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:28.857648 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6061ccec-6e2d-42b9-912d-7f0469a2ca26 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.884570 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6061ccec-6e2d-42b9-912d-7f0469a2ca26 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.938415 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6061ccec-6e2d-42b9-912d-7f0469a2ca26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.942407 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4c603f1c-129d-4783-868a-44d418ae5ade admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:28.953766 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6061ccec-6e2d-42b9-912d-7f0469a2ca26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9aec4ddc-743a-4827-b2c3-63015be829fd,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:28.956020 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6061ccec-6e2d-42b9-912d-7f0469a2ca26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:28.962067 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6061ccec-6e2d-42b9-912d-7f0469a2ca26 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:28.963179 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6061ccec-6e2d-42b9-912d-7f0469a2ca26 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9aec4ddc-743a-4827-b2c3-63015be829fd HTTP/1.1" status: 204 len: 168 time: 0.1671975 May 20 20:37:29.266690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45072) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:29.285298 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:29.300211 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:29.304313 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Usage tracker for resource:security_group_rule and tenant:7a2725b94f024d59ae5a49f66a5cbdfd is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:29.307708 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:29.313403 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:29.397320 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:29.401787 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:29.410148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:29.448790 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7a2725b94f024d59ae5a49f66a5cbdfd&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1808352 May 20 20:37:29.450441 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b49b497-7ec6-4e65-bc95-6f19b09f6177,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:29.451490 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45078) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:29.453397 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:29.515203 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:29.543300 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:29.596117 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:29.601101 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9bd14b79-cd4e-4802-9407-1ddac16c41d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:29.613607 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b49b497-7ec6-4e65-bc95-6f19b09f6177,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:29.617048 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:29.623165 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:29.626686 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3b49b497-7ec6-4e65-bc95-6f19b09f6177 HTTP/1.1" status: 204 len: 168 time: 0.1709440 May 20 20:37:30.401985 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45116) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:30.506114 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1522778912-network', 'tenant_id': 'e006b360cfe54ccca9e3ba7519cd9fdf'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:37:30.510847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:30.515016 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Usage tracker for resource:network and tenant:e006b360cfe54ccca9e3ba7519cd9fdf is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:30.517899 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:30.528550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:30.538354 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Made reservation on behalf of e006b360cfe54ccca9e3ba7519cd9fdf for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:37:30.541478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.553550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.567522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:30.571326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Usage tracker for resource:security_group_rule and tenant:e006b360cfe54ccca9e3ba7519cd9fdf is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:30.574077 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:30.579634 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:30.662596 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.667327 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.672026 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-458339e0-1341-407a-a4c0-3ca7b518cca9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:30.690256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] vlan segment allocate from pool success with {'vlan_id': 842, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:37:30.711652 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba5e3faf-6573-4e8e-98ea-222b0720d189,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:30.714927 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:30.716084 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.716418 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Added segment 2bf6ac89-2952-4de6-ad1d-427e2f8c6dc9 of type vlan for network ab415180-0d8a-436a-aea0-2b871a37c09a May 20 20:37:30.742527 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.770520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.771805 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:30.772368 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:30.777358 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f334c608-fca6-4090-b910-72e9634681d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:30.876912 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Pushing event updated for resources: {'Network': ['ID=ab415180-0d8a-436a-aea0-2b871a37c09a,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:30.879531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:30.881408 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4784026 May 20 20:37:30.885255 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45122) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:30.888779 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network ab415180-0d8a-436a-aea0-2b871a37c09a details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:37:30.890781 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Request body: {'subnet': {'network_id': 'ab415180-0d8a-436a-aea0-2b871a37c09a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1522778912-subnet', 'tenant_id': 'e006b360cfe54ccca9e3ba7519cd9fdf', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:37:30.895673 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:30.900200 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Usage tracker for resource:subnet and tenant:e006b360cfe54ccca9e3ba7519cd9fdf is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:30.903118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:30.908780 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:30.918600 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Made reservation on behalf of e006b360cfe54ccca9e3ba7519cd9fdf for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:37:30.920804 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3870000'] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:31.301743 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2785475', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3869986'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:31.307161 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:31.380406 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5ee9a32d-079a-4641-948e-a4761b27221e,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:31.385100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:31.386045 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Checking segment: {'id': '2bf6ac89-2952-4de6-ad1d-427e2f8c6dc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': 'ab415180-0d8a-436a-aea0-2b871a37c09a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:37:31.386436 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Network hostable DHCP agents. Network: ab415180-0d8a-436a-aea0-2b871a37c09a, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:37:31.404058 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Network ab415180-0d8a-436a-aea0-2b871a37c09a is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:37:31.413774 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, ab415180-0d8a-436a-aea0-2b871a37c09a) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:37:31.434670 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:31.435096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f74e2c19-eea2-4abf-9778-e2a922157235 None None] Network ab415180-0d8a-436a-aea0-2b871a37c09a requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:37:31.435404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:31.469019 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a86f2af8-ca77-425d-92a9-dd93e4e2b164 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5752056 May 20 20:37:31.669878 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-501b15a2-7c57-4b71-98dd-4da558f1d58d None None] Network ab415180-0d8a-436a-aea0-2b871a37c09a requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:37:32.006221 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45156) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:32.012020 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1369506311-network', 'tenant_id': '151a9d49e32c435ab790508974e97547'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:37:32.016698 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:32.020489 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Usage tracker for resource:network and tenant:151a9d49e32c435ab790508974e97547 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:32.023323 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:32.029851 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:32.040830 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Made reservation on behalf of 151a9d49e32c435ab790508974e97547 for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:37:32.043546 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.058789 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.072834 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:32.076548 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Usage tracker for resource:security_group_rule and tenant:151a9d49e32c435ab790508974e97547 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:32.079266 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:32.084823 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:32.169613 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.173227 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.177126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-31850e0b-6a7a-40d9-af58-f425982ca2c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:32.199610 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] vlan segment allocate from pool success with {'vlan_id': 807, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:37:32.212492 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40b5b31a-1381-47e5-b25c-b86d4edcded1,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:32.216444 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:32.217353 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.217679 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Added segment 76211b9b-c769-4f1a-b188-14f0298342f7 of type vlan for network ed583598-f798-4e3e-8ec4-32268856800e May 20 20:37:32.243746 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.271671 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.272988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:32.274486 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.279122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:32.376584 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3692596 May 20 20:37:32.379306 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45160) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:32.380099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Pushing event updated for resources: {'Network': ['ID=ed583598-f798-4e3e-8ec4-32268856800e,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:32.383419 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:32.386394 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Request body: {'subnet': {'network_id': 'ed583598-f798-4e3e-8ec4-32268856800e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1369506311-subnet', 'tenant_id': '151a9d49e32c435ab790508974e97547', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:37:32.390410 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network ed583598-f798-4e3e-8ec4-32268856800e details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:37:32.392028 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:32.395902 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Usage tracker for resource:subnet and tenant:151a9d49e32c435ab790508974e97547 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:32.399424 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:32.405839 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:32.419046 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Made reservation on behalf of 151a9d49e32c435ab790508974e97547 for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:37:32.421573 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4127911'] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.914654 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3178265', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4127925'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:32.920333 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:32.993398 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f6b4a2ac-653f-4c0f-b62c-a8478d1e08c2,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:32.997098 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:33.003108 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Checking segment: {'id': '76211b9b-c769-4f1a-b188-14f0298342f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 807, 'network_id': 'ed583598-f798-4e3e-8ec4-32268856800e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:37:33.003458 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Network hostable DHCP agents. Network: ed583598-f798-4e3e-8ec4-32268856800e, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:37:33.020407 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Network ed583598-f798-4e3e-8ec4-32268856800e is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:37:33.026454 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45172) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:33.032820 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, ed583598-f798-4e3e-8ec4-32268856800e) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:37:33.043853 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:37:33.044291 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ee571fd-32c7-4a15-a1b3-6b7e00ba03d0 None None] Network ed583598-f798-4e3e-8ec4-32268856800e requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:37:33.044466 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.065611 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-796fda3c-0b64-4acb-a2cc-67e02b4872b7 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6850522 May 20 20:37:33.151126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.165936 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:33.169912 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Usage tracker for resource:security_group_rule and tenant:3d429143f3cf4996befac11075b8b560 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:33.172721 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:33.178435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:33.251983 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe76f429-72a1-407d-9f94-667fb11fe653 None None] Network ed583598-f798-4e3e-8ec4-32268856800e requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:37:33.274341 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.278955 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.288126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-85566048-73af-4a0a-bdd2-17f2506f782f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:33.333345 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3d429143f3cf4996befac11075b8b560&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3067520 May 20 20:37:33.335918 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45184) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:33.339657 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d16e571-8105-4d63-b0ca-38d163adf031,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:33.342751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-de88b595-14fe-4b52-a673-2ef6eb382502 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:33.407261 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0575c600-3e3d-43bb-92cd-3e111a352f25 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.437953 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0575c600-3e3d-43bb-92cd-3e111a352f25 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.493488 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0575c600-3e3d-43bb-92cd-3e111a352f25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.499028 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:33.512588 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0575c600-3e3d-43bb-92cd-3e111a352f25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d16e571-8105-4d63-b0ca-38d163adf031,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:33.515337 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0575c600-3e3d-43bb-92cd-3e111a352f25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:33.516391 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0575c600-3e3d-43bb-92cd-3e111a352f25 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:33.520197 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-0575c600-3e3d-43bb-92cd-3e111a352f25 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7d16e571-8105-4d63-b0ca-38d163adf031 HTTP/1.1" status: 204 len: 168 time: 0.1796379 May 20 20:37:34.772137 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ae746892-6e99-4e02-82be-a289742a7c93 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.518371 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45264) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:35.634683 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.649415 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:35.653345 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Usage tracker for resource:security_group_rule and tenant:999f70a8905647098a39446be9dacc86 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:35.656100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:35.661706 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:35.748674 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.752505 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.764228 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9305cdf7-02aa-4ab8-8c11-3e6b4a2d5a0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:35.807598 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=999f70a8905647098a39446be9dacc86&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2881544 May 20 20:37:35.808500 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c8ea370-115c-4aa5-bc4b-33860c46cd89,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:35.811286 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45270) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:35.811840 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fdf293eb-65df-4c67-8b29-3c764fa8938f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:35.873370 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7bce6a31-5c6b-40fd-ace4-02a080ec7920 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.900198 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7bce6a31-5c6b-40fd-ace4-02a080ec7920 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.952420 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7bce6a31-5c6b-40fd-ace4-02a080ec7920 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.957211 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-c89fed67-2e2b-4818-a84d-05f2cda4b8b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:35.970591 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bce6a31-5c6b-40fd-ace4-02a080ec7920 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c8ea370-115c-4aa5-bc4b-33860c46cd89,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:35.973386 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7bce6a31-5c6b-40fd-ace4-02a080ec7920 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:35.974311 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-7bce6a31-5c6b-40fd-ace4-02a080ec7920 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:35.975393 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-7bce6a31-5c6b-40fd-ace4-02a080ec7920 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5c8ea370-115c-4aa5-bc4b-33860c46cd89 HTTP/1.1" status: 204 len: 168 time: 0.1626134 May 20 20:37:36.252123 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45278) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:36.270041 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:36.284733 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:36.288475 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Usage tracker for resource:security_group_rule and tenant:1d8dfc70fb6f4ebab069465ca054b6c4 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:36.291555 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:36.297655 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:36.384663 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:36.388608 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:36.397027 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6e581b46-602f-4fd7-8429-d40a7d1305d1 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:36.438100 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1d8dfc70fb6f4ebab069465ca054b6c4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1848278 May 20 20:37:36.439031 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b90f975-0e30-497d-a305-7f07b4528d33,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:36.440651 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45282) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:36.442159 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-92e36b9d-ed39-43e0-8972-12953259ef56 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:36.501305 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:36.528765 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:36.584176 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:36.588426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-318e08fa-42c9-4e2b-ac62-db741872f87b tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:36.601280 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b90f975-0e30-497d-a305-7f07b4528d33,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:36.604755 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:36.612389 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:36.613501 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8b90f975-0e30-497d-a305-7f07b4528d33 HTTP/1.1" status: 204 len: 168 time: 0.1717677 May 20 20:37:37.240360 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:37.500385 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7007e315-d0af-43f1-82ec-6e768ece5e75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:37.787659 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45322) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:37.903464 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:37.917319 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:37.921365 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Usage tracker for resource:security_group_rule and tenant:f4c37dba85394822ad7a2f5d18feea0c is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:37.924106 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:37.930139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:38.017678 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:38.022331 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:38.035658 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e8d61486-9885-4f19-a9b8-0bd24daeaad9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:38.074485 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f4c37dba85394822ad7a2f5d18feea0c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2856920 May 20 20:37:38.077062 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45332) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:38.079658 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a97f664-4f5e-4255-b9fe-250a0a525392,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:38.082894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c25108f9-502c-4170-968a-109ec32eccd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:38.142665 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9f65e92c-55ec-4ef3-9bb1-deedfc89d35b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:38.170054 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9f65e92c-55ec-4ef3-9bb1-deedfc89d35b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:38.229955 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9f65e92c-55ec-4ef3-9bb1-deedfc89d35b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:38.234015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b6c30b39-d045-45c5-8bfd-b0d9edf7fa33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:38.247333 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f65e92c-55ec-4ef3-9bb1-deedfc89d35b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a97f664-4f5e-4255-b9fe-250a0a525392,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:38.250187 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9f65e92c-55ec-4ef3-9bb1-deedfc89d35b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:38.252281 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-9f65e92c-55ec-4ef3-9bb1-deedfc89d35b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:38.256479 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-9f65e92c-55ec-4ef3-9bb1-deedfc89d35b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6a97f664-4f5e-4255-b9fe-250a0a525392 HTTP/1.1" status: 204 len: 168 time: 0.1754403 May 20 20:37:38.323829 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:39.931422 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:45.073092 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:49.612919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45514) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:49.672394 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_v2 [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Deleting subnet 5ee9a32d-079a-4641-948e-a4761b27221e {{(pid=91645) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:37:49.676063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:49.731458 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3093741'] for subnet, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:49.785890 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.038613 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3178326', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4127932'] for subnet, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.045632 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:50.081366 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5ee9a32d-079a-4641-948e-a4761b27221e,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:50.084406 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.094991 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.095364 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.095728 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.096111 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.096464 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.096818 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.097168 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.097519 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.097866 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.098216 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.098559 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.098900 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:50.104832 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:50.107206 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-aeb751c8-d1f2-48f5-9d0e-e35893248434 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5ee9a32d-079a-4641-948e-a4761b27221e HTTP/1.1" status: 204 len: 168 time: 0.4933045 May 20 20:37:50.109747 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45518) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:50.217225 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.341533 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.354031 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ab415180-0d8a-436a-aea0-2b871a37c09a']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:50.365656 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2bf6ac89-2952-4de6-ad1d-427e2f8c6dc9') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:50.365939 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2bf6ac89-2952-4de6-ad1d-427e2f8c6dc9') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:50.376977 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.393336 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.400122 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Releasing vlan 842 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:37:50.400507 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:37:50.413422 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:37:50.490162 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.495438 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-7804932f-6d6f-4f07-b416-79e3f1b8002e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:50.511602 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.517572 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Pushing event deleted for resources: {'Network': ['ID=ab415180-0d8a-436a-aea0-2b871a37c09a,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:50.520597 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:50.522904 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fde1fd49-d25a-4bda-bbdb-7d4c5ebe48d1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/ab415180-0d8a-436a-aea0-2b871a37c09a HTTP/1.1" status: 204 len: 168 time: 0.4121356 May 20 20:37:50.526678 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45524) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:50.586461 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_v2 [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Deleting subnet f6b4a2ac-653f-4c0f-b62c-a8478d1e08c2 {{(pid=91645) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:37:50.589762 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.643368 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3093741'] for subnet, precommit_delete_associations {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:50.701115 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.050115 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3178326', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4127932'] for subnet, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.055046 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:51.089689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f6b4a2ac-653f-4c0f-b62c-a8478d1e08c2,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:51.092772 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:51.093810 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.099592 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-e83737dc-9b21-44e1-b0e6-b8863e060638 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/f6b4a2ac-653f-4c0f-b62c-a8478d1e08c2 HTTP/1.1" status: 204 len: 168 time: 0.5718017 May 20 20:37:51.102584 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45528) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:51.207529 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.331832 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.344777 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ed583598-f798-4e3e-8ec4-32268856800e']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:51.361945 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '76211b9b-c769-4f1a-b188-14f0298342f7') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:51.362241 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '76211b9b-c769-4f1a-b188-14f0298342f7') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:37:51.374604 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.390292 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.396218 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Releasing vlan 807 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:37:51.396607 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:37:51.409928 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:37:51.485390 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.489148 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-506bdbb1-63f0-48fb-a50e-c9a8c03f7829 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:51.502926 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.516367 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Pushing event deleted for resources: {'Network': ['ID=ed583598-f798-4e3e-8ec4-32268856800e,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:51.518758 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] 10.222.0.82 "DELETE /v2.0/networks/ed583598-f798-4e3e-8ec4-32268856800e HTTP/1.1" status: 204 len: 168 time: 0.4152427 May 20 20:37:51.519616 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-5440b26e-c9bf-48f6-b6e1-4c3f1eef8686 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:51.701032 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45536) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:51.750115 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-69d52e81-66f2-41cb-9aae-18707ff811d8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e006b360cfe54ccca9e3ba7519cd9fdf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0478404 May 20 20:37:51.752492 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45540) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:51.811477 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d843b268-8808-44d3-b036-4e144e922289 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.837500 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d843b268-8808-44d3-b036-4e144e922289 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.889062 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d843b268-8808-44d3-b036-4e144e922289 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.894091 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-9b2f623b-de62-4e3d-9eae-ea42e7a93cc8 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:51.908413 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d843b268-8808-44d3-b036-4e144e922289 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba5e3faf-6573-4e8e-98ea-222b0720d189,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:51.910837 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-d843b268-8808-44d3-b036-4e144e922289 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:51.912985 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-d843b268-8808-44d3-b036-4e144e922289 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:51.914452 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-d843b268-8808-44d3-b036-4e144e922289 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ba5e3faf-6573-4e8e-98ea-222b0720d189 HTTP/1.1" status: 204 len: 168 time: 0.1608582 May 20 20:37:52.257237 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45548) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:52.307848 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4f81d841-fbe2-417c-8798-06a4aa7ccebe admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=151a9d49e32c435ab790508974e97547&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0486326 May 20 20:37:52.310178 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45552) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:52.372475 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-77139803-05b2-4a5c-bf71-0363a70a502e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:52.400912 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-77139803-05b2-4a5c-bf71-0363a70a502e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:52.453409 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-77139803-05b2-4a5c-bf71-0363a70a502e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:52.458585 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-706cffcd-f8bb-4344-8a47-51d3b4aacfa2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:52.472736 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77139803-05b2-4a5c-bf71-0363a70a502e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40b5b31a-1381-47e5-b25c-b86d4edcded1,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:52.475659 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-77139803-05b2-4a5c-bf71-0363a70a502e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:52.478217 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-77139803-05b2-4a5c-bf71-0363a70a502e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:52.480106 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-77139803-05b2-4a5c-bf71-0363a70a502e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/40b5b31a-1381-47e5-b25c-b86d4edcded1 HTTP/1.1" status: 204 len: 168 time: 0.1689694 May 20 20:37:54.810590 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:37:57.274493 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45630) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:57.394763 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:57.409588 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:37:57.413359 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Usage tracker for resource:security_group_rule and tenant:1105d578b71c495e85409428568b244e is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:37:57.416493 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:37:57.422436 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:37:57.510643 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:57.514743 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:57.522979 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-855d8a06-e3ef-4ad9-9574-9f6791b49ec1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:57.565110 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1105d578b71c495e85409428568b244e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2893376 May 20 20:37:57.566761 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b09450ed-f9a7-470c-a2ca-1deab3378f1b,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:57.567739 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45636) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:37:57.569993 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:37:57.631986 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:57.657529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:57.711168 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:57.714893 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2c06e17e-ac19-4858-a669-c246d0f84eb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:37:57.727494 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b09450ed-f9a7-470c-a2ca-1deab3378f1b,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:37:57.736588 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.736957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.737322 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.737677 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.738024 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.738372 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.738719 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.739062 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.739408 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.739755 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.740118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.740454 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:37:57.743787 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:37:57.744863 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b09450ed-f9a7-470c-a2ca-1deab3378f1b HTTP/1.1" status: 204 len: 168 time: 0.1761470 May 20 20:37:57.745788 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c4cd22ef-38c4-4454-8bc8-f2c6e7e36288 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:00.213461 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-4f3a7fe1-52c1-47e1-a6de-4585112ad391 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=0ee77cf7f16d460bbdac8d9537d84e36&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0292051 May 20 20:38:00.449918 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-8fdc6207-2f95-4bea-91cb-371baedcb927 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:00.451399 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-8fdc6207-2f95-4bea-91cb-371baedcb927 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2325943 May 20 20:38:00.468208 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-3868bc38-0b88-49ee-88fe-ae3b2da27bd2 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/quotas/0ee77cf7f16d460bbdac8d9537d84e36 HTTP/1.1" status: 200 len: 375 time: 0.0111437 May 20 20:38:00.517405 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-f1a261c7-8987-46a0-9c21-8c34cc0e57e5 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0ee77cf7f16d460bbdac8d9537d84e36&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0442867 May 20 20:38:00.697620 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-05c5db5e-bd43-4cec-9a17-de6d5f1a3133 req-f1ff4c89-dfe1-4869-bba3-c80005b11108 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 210 time: 0.0447202 May 20 20:38:01.866150 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-73231fe9-5d24-43e9-8b9a-ed97e7868c7b req-a76268af-dade-423c-bf27-0cdb0d78df87 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 210 time: 0.0609326 May 20 20:38:01.875437 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0c057c4e-42b9-487f-b374-2e45df979557 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.69 "GET /v2.0/networks?tenant_id=0ee77cf7f16d460bbdac8d9537d84e36&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0342052 May 20 20:38:02.031404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-90f56e02-524f-4918-9315-c549e829bce3 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:02.032766 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-90f56e02-524f-4918-9315-c549e829bce3 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.69 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1479208 May 20 20:38:02.055185 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Request body: {'port': {'device_id': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1', 'admin_state_up': True, 'tenant_id': '0ee77cf7f16d460bbdac8d9537d84e36'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:02.189422 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:02.193126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Usage tracker for resource:port and tenant:0ee77cf7f16d460bbdac8d9537d84e36 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:38:02.195832 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:38:02.202063 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:02.212368 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Made reservation on behalf of 0ee77cf7f16d460bbdac8d9537d84e36 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:38:02.215857 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:02.228564 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:02.243175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:02.248166 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Usage tracker for resource:security_group_rule and tenant:0ee77cf7f16d460bbdac8d9537d84e36 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:38:02.250883 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:38:02.256465 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:02.348977 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:02.353269 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:02.357530 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-78c147dd-fcb7-424c-b462-0c0731dae2ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:02.439556 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Pushing event updated for resources: {'SecurityGroup': ['ID=deaa68ab-d108-4bdd-964f-323bb211aa60,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:02.443070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:02.531056 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Allocated IP 192.168.233.140 (2b1283d5-cab9-4b45-879a-1d09bbf331c1/c3a7ac06-3392-4dcf-a75b-e9418337579c/29bcba98-92ef-46bd-986e-f7ffbcc3057c) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:38:02.732957 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:02.748123 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Transition to ACTIVE for port object 29bcba98-92ef-46bd-986e-f7ffbcc3057c will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:38:02.770220 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:02.775989 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-472de6d8-6620-4d26-a72f-3c8c9d75b7bb tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:02.838050 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:38:02.839213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:38:02.843147 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:38:02.887276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Pushing event updated for resources: {'Port': ['ID=29bcba98-92ef-46bd-986e-f7ffbcc3057c,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:02.895424 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:02.917517 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:02.918673 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:02.945218 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.8938160 May 20 20:38:02.962520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-00239fd1-d062-46ff-bda9-d5fae80bb4db tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:38:02.964000 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-00239fd1-d062-46ff-bda9-d5fae80bb4db tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.69 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0064712 May 20 20:38:03.058428 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf83024-c736-47f5-8ead-600af22959e0 req-72dba900-7351-4f56-bfd9-5b1c2abafa6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:03.060572 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7bf83024-c736-47f5-8ead-600af22959e0 req-72dba900-7351-4f56-bfd9-5b1c2abafa6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 936 time: 0.0831850 May 20 20:38:03.069427 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-cd2be446-2cbd-41cf-9e0a-f091530c3f8f None None] Provisioning for port 29bcba98-92ef-46bd-986e-f7ffbcc3057c completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:38:03.074783 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-cd2be446-2cbd-41cf-9e0a-f091530c3f8f None None] Provisioning complete for port 29bcba98-92ef-46bd-986e-f7ffbcc3057c triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:38:03.075166 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-cd2be446-2cbd-41cf-9e0a-f091530c3f8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:03.093956 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Request body: {'port': {'device_id': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:03.106334 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7bf83024-c736-47f5-8ead-600af22959e0 req-e47c8fa5-551f-4b1d-be9f-a0d9610fbd27 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391409 May 20 20:38:03.134647 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-cd2be446-2cbd-41cf-9e0a-f091530c3f8f None None] Port 29bcba98-92ef-46bd-986e-f7ffbcc3057c cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:38:03.204688 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:03.544155 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 29bcba98-92ef-46bd-986e-f7ffbcc3057c {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:38:03.551312 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:03.565511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Transition to ACTIVE for port object 29bcba98-92ef-46bd-986e-f7ffbcc3057c will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:38:03.568406 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:03.571908 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cdb9bc42-be24-475b-bd29-5099ead6fc85 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:03.800115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Pushing event updated for resources: {'Port': ['ID=29bcba98-92ef-46bd-986e-f7ffbcc3057c,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:03.825894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:03.901934 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Attempting to bind port 29bcba98-92ef-46bd-986e-f7ffbcc3057c on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:38:03.902568 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Attempting to bind port 29bcba98-92ef-46bd-986e-f7ffbcc3057c by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:38:03.902568 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Attempting to bind port 29bcba98-92ef-46bd-986e-f7ffbcc3057c on network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:38:03.907088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Port 29bcba98-92ef-46bd-986e-f7ffbcc3057c on network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:38:03.907395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Attempting to bind port 29bcba98-92ef-46bd-986e-f7ffbcc3057c on network 2b1283d5-cab9-4b45-879a-1d09bbf331c1 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:38:03.912395 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 37, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:38:03.912720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Checking segment: {'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:38:03.913093 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Bound using segment: {'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:38:03.913502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Bound port: 29bcba98-92ef-46bd-986e-f7ffbcc3057c, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '86f13d3e-0be6-42ff-b615-3d835f455446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 827, 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:38:03.913837 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:04.001044 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] For port 29bcba98-92ef-46bd-986e-f7ffbcc3057c, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:38:04.004173 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] For port 29bcba98-92ef-46bd-986e-f7ffbcc3057c, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=29bcba98-92ef-46bd-986e-f7ffbcc3057c,segment=NetworkSegment(86f13d3e-0be6-42ff-b615-3d835f455446),segment_id=86f13d3e-0be6-42ff-b615-3d835f455446)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:38:04.008071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:04.013074 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b36-a426-495b-9558-e75d1e6ff550 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:04.069725 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:04.070335 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:04.072232 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] 10.222.0.69 "PUT /v2.0/ports/29bcba98-92ef-46bd-986e-f7ffbcc3057c HTTP/1.1" status: 200 len: 1098 time: 1.0944934 May 20 20:38:04.072877 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'tag': '29bcba98-92ef-46bd-986e-f7ffbcc3057c'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:04.099036 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Pushing event updated for resources: {'Port': ['ID=29bcba98-92ef-46bd-986e-f7ffbcc3057c,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:04.107931 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:04.158844 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'tag': '29bcba98-92ef-46bd-986e-f7ffbcc3057c', 'status': 'completed', 'code': 200} May 20 20:38:04.201380 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-7da0a64b-f78f-4899-867d-f3c531b32dcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:04.202932 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-7da0a64b-f78f-4899-867d-f3c531b32dcf service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0ee77cf7f16d460bbdac8d9537d84e36&device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 1101 time: 0.0778129 May 20 20:38:04.284235 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-1f42f175-67d9-455c-bcfa-00e3e53f457a service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=29bcba98-92ef-46bd-986e-f7ffbcc3057c HTTP/1.1" status: 200 len: 217 time: 0.0651197 May 20 20:38:04.304288 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190cee1d-b85b-4f30-839f-a5a25e6487e6 req-15d45028-a15b-4e1c-9bbf-be3c508df2d8 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:04.306335 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-190cee1d-b85b-4f30-839f-a5a25e6487e6 req-15d45028-a15b-4e1c-9bbf-be3c508df2d8 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 948 time: 0.0899992 May 20 20:38:04.352046 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-190cee1d-b85b-4f30-839f-a5a25e6487e6 req-a1fcb144-8472-4cd6-8bbf-5db92f37262c tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398512 May 20 20:38:04.357777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-62789a37-ccd3-4d75-bd12-e0d40d2726c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:04.359204 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-62789a37-ccd3-4d75-bd12-e0d40d2726c0 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=c3a7ac06-3392-4dcf-a75b-e9418337579c HTTP/1.1" status: 200 len: 843 time: 0.0596125 May 20 20:38:04.444294 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-5f80bbf5-1ac7-44b8-9fc3-50f23dc4d6b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:04.445743 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-5f80bbf5-1ac7-44b8-9fc3-50f23dc4d6b7 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2b1283d5-cab9-4b45-879a-1d09bbf331c1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1179 time: 0.0739689 May 20 20:38:04.585872 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-5303c4d8-3569-4a83-a0a0-b6a97939c741 service neutron] 10.222.0.69 "GET /v2.0/networks/2b1283d5-cab9-4b45-879a-1d09bbf331c1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280472 May 20 20:38:04.724614 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ef39b22-daeb-4b7d-8e26-b0450be78f12 req-1d582b1d-89e0-4e8e-99a6-a4406bec34cf service neutron] 10.222.0.69 "GET /v2.0/networks/2b1283d5-cab9-4b45-879a-1d09bbf331c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250956 May 20 20:38:04.776403 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-38df653d-678c-469a-a083-d44fa4f49f49 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:04.856550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b52af6-6000-4113-a269-0965907418b5 req-5c1e3097-004e-4c6f-9046-1027e57f56de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:04.858046 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71b52af6-6000-4113-a269-0965907418b5 req-5c1e3097-004e-4c6f-9046-1027e57f56de service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0ee77cf7f16d460bbdac8d9537d84e36&device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 1101 time: 0.0717821 May 20 20:38:04.995228 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b52af6-6000-4113-a269-0965907418b5 req-0899563a-bc4b-4194-82e5-c57dc154e427 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:04.996581 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71b52af6-6000-4113-a269-0965907418b5 req-0899563a-bc4b-4194-82e5-c57dc154e427 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2b1283d5-cab9-4b45-879a-1d09bbf331c1 HTTP/1.1" status: 200 len: 870 time: 0.1267800 May 20 20:38:05.068463 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71b52af6-6000-4113-a269-0965907418b5 req-546ff7a7-63fa-43a5-a28b-a815881623dd service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=29bcba98-92ef-46bd-986e-f7ffbcc3057c HTTP/1.1" status: 200 len: 217 time: 0.0622005 May 20 20:38:05.134887 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b52af6-6000-4113-a269-0965907418b5 req-80304991-6e2d-4512-90ae-3aae64bab475 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:05.136323 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71b52af6-6000-4113-a269-0965907418b5 req-80304991-6e2d-4512-90ae-3aae64bab475 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=c3a7ac06-3392-4dcf-a75b-e9418337579c HTTP/1.1" status: 200 len: 843 time: 0.0567832 May 20 20:38:05.218649 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b52af6-6000-4113-a269-0965907418b5 req-d49aa3df-80be-474a-abc6-ebfd47ce4574 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:05.220123 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71b52af6-6000-4113-a269-0965907418b5 req-d49aa3df-80be-474a-abc6-ebfd47ce4574 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2b1283d5-cab9-4b45-879a-1d09bbf331c1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1179 time: 0.0727694 May 20 20:38:05.353128 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71b52af6-6000-4113-a269-0965907418b5 req-b9a54a71-e071-424c-aae1-21652f73d631 service neutron] 10.222.0.69 "GET /v2.0/networks/2b1283d5-cab9-4b45-879a-1d09bbf331c1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1223083 May 20 20:38:05.647586 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-71b52af6-6000-4113-a269-0965907418b5 req-d33a837c-d764-4f5e-b8cc-513ee9dda377 service neutron] 10.222.0.69 "GET /v2.0/networks/2b1283d5-cab9-4b45-879a-1d09bbf331c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2815802 May 20 20:38:05.671117 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc5194f8-f80e-4b6b-8f23-3ba483114e76 req-e5bea065-fbdc-4019-82ff-bd36513f097b tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:05.671905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-fc5194f8-f80e-4b6b-8f23-3ba483114e76 req-e5bea065-fbdc-4019-82ff-bd36513f097b tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Synchronizing usage tracker for tenant:0ee77cf7f16d460bbdac8d9537d84e36 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:38:05.688874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-fc5194f8-f80e-4b6b-8f23-3ba483114e76 req-e5bea065-fbdc-4019-82ff-bd36513f097b tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Unset dirty status for tenant:0ee77cf7f16d460bbdac8d9537d84e36 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:38:05.690127 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fc5194f8-f80e-4b6b-8f23-3ba483114e76 req-e5bea065-fbdc-4019-82ff-bd36513f097b tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 948 time: 0.2297659 May 20 20:38:05.735679 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-fc5194f8-f80e-4b6b-8f23-3ba483114e76 req-5f5aa0fc-f008-448f-835c-beccb7751403 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Synchronizing usage tracker for tenant:0ee77cf7f16d460bbdac8d9537d84e36 on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:38:05.758235 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-fc5194f8-f80e-4b6b-8f23-3ba483114e76 req-5f5aa0fc-f008-448f-835c-beccb7751403 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Unset dirty status for tenant:0ee77cf7f16d460bbdac8d9537d84e36 on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:38:05.760049 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fc5194f8-f80e-4b6b-8f23-3ba483114e76 req-5f5aa0fc-f008-448f-835c-beccb7751403 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641296 May 20 20:38:06.953557 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9130a2-9152-438f-8aa8-7da70da0e92a req-a4d81333-7212-410a-a3d9-4e9e6ab30b7e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:06.955023 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fa9130a2-9152-438f-8aa8-7da70da0e92a req-a4d81333-7212-410a-a3d9-4e9e6ab30b7e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 948 time: 0.0833304 May 20 20:38:07.000132 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fa9130a2-9152-438f-8aa8-7da70da0e92a req-1401ae0a-d4ff-43a6-9488-506fb5d67c5e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392616 May 20 20:38:07.221016 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:07.502870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-74081f12-49b4-46c4-a799-cd4185f2d3cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:07.841557 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45760) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:38:07.957992 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:07.972828 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:07.976760 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Usage tracker for resource:security_group_rule and tenant:b9c1f87d07c84295b05fd1f6a7623923 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:38:07.979654 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:38:07.985265 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:08.073984 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.077923 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.086472 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:08.160281 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b9c1f87d07c84295b05fd1f6a7623923&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3176410 May 20 20:38:08.162922 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45768) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:38:08.166708 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b329973-5e9f-48c5-bef3-e68a557585cc,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:08.168769 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 29bcba98-92ef-46bd-986e-f7ffbcc3057c details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:38:08.170745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0a890c3a-e162-47da-b2cc-8a8862893a9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:08.216760 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c255c7-6e03-41c7-b2c5-1d4272fdd7d0 req-6ddff71e-859d-4cc2-a885-768737a0b593 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:08.218752 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37c255c7-6e03-41c7-b2c5-1d4272fdd7d0 req-6ddff71e-859d-4cc2-a885-768737a0b593 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 948 time: 0.1036420 May 20 20:38:08.238375 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3dbd18c4-8936-4c2b-8fa2-4867f2429961 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.266385 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3dbd18c4-8936-4c2b-8fa2-4867f2429961 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.269205 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37c255c7-6e03-41c7-b2c5-1d4272fdd7d0 req-b9fcdf7c-1281-4bc7-bb30-bfa94ee5b7e6 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448303 May 20 20:38:08.323976 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 29bcba98-92ef-46bd-986e-f7ffbcc3057c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=29bcba98-92ef-46bd-986e-f7ffbcc3057c,segment=NetworkSegment(86f13d3e-0be6-42ff-b615-3d835f455446),segment_id=86f13d3e-0be6-42ff-b615-3d835f455446)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:08.329250 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3dbd18c4-8936-4c2b-8fa2-4867f2429961 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.331983 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.334263 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0510dc6f-d6ec-4b0f-a6a8-6a1753d60355 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:08.338417 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '29bcba98-92ef-46bd-986e-f7ffbcc3057c', 'network_id': '2b1283d5-cab9-4b45-879a-1d09bbf331c1', 'port_id': '29bcba98-92ef-46bd-986e-f7ffbcc3057c', 'mac_address': 'fa:16:3e:87:74:6b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 827, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c3a7ac06-3392-4dcf-a75b-e9418337579c', 'ip_address': '192.168.233.140'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:38:08.346818 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dbd18c4-8936-4c2b-8fa2-4867f2429961 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b329973-5e9f-48c5-bef3-e68a557585cc,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:08.350394 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3dbd18c4-8936-4c2b-8fa2-4867f2429961 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:08.359655 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3dbd18c4-8936-4c2b-8fa2-4867f2429961 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.360796 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3dbd18c4-8936-4c2b-8fa2-4867f2429961 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7b329973-5e9f-48c5-bef3-e68a557585cc HTTP/1.1" status: 204 len: 168 time: 0.1968815 May 20 20:38:08.404238 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.421599 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 29bcba98-92ef-46bd-986e-f7ffbcc3057c {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:38:08.436741 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 29bcba98-92ef-46bd-986e-f7ffbcc3057c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=29bcba98-92ef-46bd-986e-f7ffbcc3057c,segment=NetworkSegment(86f13d3e-0be6-42ff-b615-3d835f455446),segment_id=86f13d3e-0be6-42ff-b615-3d835f455446)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:08.441094 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:08.444125 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:08.518597 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=29bcba98-92ef-46bd-986e-f7ffbcc3057c,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:08.521979 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:08.813869 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['29bcba98-92ef-46bd-986e-f7ffbcc3057c'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:38:09.038433 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 45792) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:38:09.143287 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1128960748-network', 'tenant_id': '5680b3ebd9354a18b1440cc2199ddbac'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:09.147926 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:09.152392 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Usage tracker for resource:network and tenant:5680b3ebd9354a18b1440cc2199ddbac is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:38:09.155159 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:38:09.161414 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:09.171192 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Made reservation on behalf of 5680b3ebd9354a18b1440cc2199ddbac for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:38:09.173754 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.185838 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.205308 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:09.209263 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Usage tracker for resource:security_group_rule and tenant:5680b3ebd9354a18b1440cc2199ddbac is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:38:09.212916 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:38:09.218640 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:09.302478 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.306825 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.310143 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b292c782-4e55-439b-892a-54ecbe089294 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:09.341354 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] vlan segment allocate from pool success with {'vlan_id': 838, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:38:09.346938 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:09.350321 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:09.356453 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.356453 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Added segment ec46f2ff-374c-45cf-be53-dce114a8ec8d of type vlan for network 04cb5cea-2512-4ea7-983d-27ece528e16b May 20 20:38:09.416577 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.465119 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.467229 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:09.467814 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.474203 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:09.525188 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e4222f-61b3-4f81-9805-d966d8a46342 req-9f5b5f2c-ba25-4186-967a-0df03607d40f tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:09.526623 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a1e4222f-61b3-4f81-9805-d966d8a46342 req-9f5b5f2c-ba25-4186-967a-0df03607d40f tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 949 time: 0.1496613 May 20 20:38:09.604128 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Pushing event updated for resources: {'Network': ['ID=04cb5cea-2512-4ea7-983d-27ece528e16b,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:09.607379 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:09.613727 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-0c43e145-f157-4473-8de2-7c2df27f3e5a admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5715933 May 20 20:38:09.614005 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 45800) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:38:09.614845 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 04cb5cea-2512-4ea7-983d-27ece528e16b details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:38:09.620808 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Request body: {'subnet': {'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1128960748-subnet', 'tenant_id': '5680b3ebd9354a18b1440cc2199ddbac', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:09.625489 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:09.629636 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Usage tracker for resource:subnet and tenant:5680b3ebd9354a18b1440cc2199ddbac is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:38:09.633110 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:38:09.637382 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-a1e4222f-61b3-4f81-9805-d966d8a46342 req-9b86f542-e3c3-4d76-a307-20f6e8f0a08a tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1044185 May 20 20:38:09.643150 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:09.653324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Made reservation on behalf of 5680b3ebd9354a18b1440cc2199ddbac for: {'subnet': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:38:09.656065 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3870000'] for subnet, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:09.925657 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:10.044105 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2785475', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3869986'] for subnet, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:10.048726 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:10.125622 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Pushing event updated for resources: {'Subnet': ['ID=df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f,revision_number=0']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:10.129291 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:10.130139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Checking segment: {'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:38:10.130487 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Network hostable DHCP agents. Network: 04cb5cea-2512-4ea7-983d-27ece528e16b, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91646) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:38:10.147923 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Network 04cb5cea-2512-4ea7-983d-27ece528e16b is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91646) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:38:10.157524 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 04cb5cea-2512-4ea7-983d-27ece528e16b) {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:38:10.166846 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:10.167422 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:10.170764 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-010b1df4-8b74-4550-933d-60334fa5e4a3 None None] Network 04cb5cea-2512-4ea7-983d-27ece528e16b requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:38:10.183215 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 29bcba98-92ef-46bd-986e-f7ffbcc3057c up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:38:10.192038 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5768671 May 20 20:38:10.401909 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 29bcba98-92ef-46bd-986e-f7ffbcc3057c completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:38:10.435884 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 29bcba98-92ef-46bd-986e-f7ffbcc3057c triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:38:10.436260 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:10.479406 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80a2b584-2f73-4447-8f20-3bbda57b12ac None None] Network 04cb5cea-2512-4ea7-983d-27ece528e16b requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:38:10.726803 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:10.770195 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29bcba98-92ef-46bd-986e-f7ffbcc3057c'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:10.781535 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 29bcba98-92ef-46bd-986e-f7ffbcc3057c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=29bcba98-92ef-46bd-986e-f7ffbcc3057c,segment=NetworkSegment(86f13d3e-0be6-42ff-b615-3d835f455446),segment_id=86f13d3e-0be6-42ff-b615-3d835f455446)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:10.789068 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:10.793553 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:10.863705 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29bcba98-92ef-46bd-986e-f7ffbcc3057c', 'code': 200} May 20 20:38:10.888462 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=29bcba98-92ef-46bd-986e-f7ffbcc3057c,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:10.891696 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:10.898707 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bbea7ea-af69-45a0-ad77-eec411f42466 req-c96a2a9d-a0b0-4cb8-afd4-7c404a28f724 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:10.900903 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bbea7ea-af69-45a0-ad77-eec411f42466 req-c96a2a9d-a0b0-4cb8-afd4-7c404a28f724 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 950 time: 0.1458054 May 20 20:38:10.950786 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6bbea7ea-af69-45a0-ad77-eec411f42466 req-8b26679c-8e75-4ad9-b08a-526cf215c4f7 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439203 May 20 20:38:11.111373 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad145e2-0d1e-47c3-ace1-aa0da87878d5 req-a4c9c97d-64fd-4e2f-a8eb-7a34c0225195 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:11.112854 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ad145e2-0d1e-47c3-ace1-aa0da87878d5 req-a4c9c97d-64fd-4e2f-a8eb-7a34c0225195 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 1103 time: 0.0702879 May 20 20:38:11.160638 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9ad145e2-0d1e-47c3-ace1-aa0da87878d5 req-2c476346-ea98-446d-bc7c-cc1cb4a135b7 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344417 May 20 20:38:12.137698 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbaf02ce-5d81-451f-bbf9-b4528cc55788 req-bed684c7-f1e9-423d-aa6d-701c0658489f tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:12.139169 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fbaf02ce-5d81-451f-bbf9-b4528cc55788 req-bed684c7-f1e9-423d-aa6d-701c0658489f tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 950 time: 0.0797825 May 20 20:38:12.184621 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-fbaf02ce-5d81-451f-bbf9-b4528cc55788 req-e9989047-c9f8-43e4-bd0b-8609d6ebcbe5 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396008 May 20 20:38:12.263347 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-2b3df8d8-0fa8-429c-b4e0-e05f8e0fd74a tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:12.264814 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-2b3df8d8-0fa8-429c-b4e0-e05f8e0fd74a tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/networks?id=04cb5cea-2512-4ea7-983d-27ece528e16b HTTP/1.1" status: 200 len: 809 time: 0.1495287 May 20 20:38:12.280715 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-18a16e24-a8f5-4c83-aa7e-7ddb780144d8 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/quotas/5680b3ebd9354a18b1440cc2199ddbac HTTP/1.1" status: 200 len: 375 time: 0.0091345 May 20 20:38:12.331246 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-301cb00f-0001-4ea7-92a4-76046a34c63c tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=5680b3ebd9354a18b1440cc2199ddbac&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0454376 May 20 20:38:12.396841 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-2c8bb8ad-50b3-418a-b692-259b8e9a9be2 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:38:12.398045 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-2c8bb8ad-50b3-418a-b692-259b8e9a9be2 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0601237 May 20 20:38:12.532221 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-0119ee3c-8ee3-4801-83c4-1eb62e3a9883 service neutron] 10.222.0.82 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273153 May 20 20:38:12.669116 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-271d3e5d-d14c-4373-a55f-8b756e4fb28f service neutron] 10.222.0.82 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1295643 May 20 20:38:12.846458 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-35a9ddef-12e9-4a27-8164-4bbee7eaa0be req-9f014117-7521-4d88-aefd-a32327a413c3 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 210 time: 0.0462222 May 20 20:38:13.372822 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8562aa86-9590-49bd-a1fc-799380bbd0f0 req-badf92dd-8ab2-4a9b-9657-cb75d3ef91a2 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:13.374286 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8562aa86-9590-49bd-a1fc-799380bbd0f0 req-badf92dd-8ab2-4a9b-9657-cb75d3ef91a2 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 950 time: 0.0785565 May 20 20:38:13.421059 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8562aa86-9590-49bd-a1fc-799380bbd0f0 req-9bd1e044-09c6-4f02-83d5-11a3f8158db8 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398979 May 20 20:38:13.961398 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a74875-b289-476b-aa71-78cf6668238c req-b38b440c-efa2-4913-8ff9-c4065c91a239 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:13.963116 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24a74875-b289-476b-aa71-78cf6668238c req-b38b440c-efa2-4913-8ff9-c4065c91a239 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 950 time: 0.1840982 May 20 20:38:14.050282 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24a74875-b289-476b-aa71-78cf6668238c req-49ce3592-be76-42f1-9478-a44eee8ca9d5 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813117 May 20 20:38:14.114143 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cd522342-d283-4aa0-ad62-3ad4d491ba56 req-6802b147-d7cc-4e76-aead-666098a1c05e tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 210 time: 0.1519055 May 20 20:38:14.162607 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-3cbf4e40-a36c-4cf2-b2e7-53c4573e4f77 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:14.164010 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-3cbf4e40-a36c-4cf2-b2e7-53c4573e4f77 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "GET /v2.0/networks?id=04cb5cea-2512-4ea7-983d-27ece528e16b HTTP/1.1" status: 200 len: 809 time: 0.1730182 May 20 20:38:14.183182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Request body: {'port': {'device_id': '5a50057a-1b2f-40da-b79b-6236556c116e', 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b', 'admin_state_up': True, 'tenant_id': '5680b3ebd9354a18b1440cc2199ddbac'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:14.322719 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:14.326462 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Usage tracker for resource:port and tenant:5680b3ebd9354a18b1440cc2199ddbac is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:38:14.329187 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:38:14.334748 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:14.345153 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Made reservation on behalf of 5680b3ebd9354a18b1440cc2199ddbac for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:38:14.348554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:14.513704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Allocated IP 172.20.0.11 (04cb5cea-2512-4ea7-983d-27ece528e16b/df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f/45b552b1-7e9b-48e3-a3b3-315f9589e694) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:38:14.715380 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:14.745144 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:14.750590 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0f656b08-ffff-41eb-a668-6250961e11b4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:14.823928 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Network 04cb5cea-2512-4ea7-983d-27ece528e16b is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:38:14.826902 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:38:14.830769 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:38:14.860706 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Pushing event updated for resources: {'Port': ['ID=45b552b1-7e9b-48e3-a3b3-315f9589e694,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:14.866827 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:14.896476 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:14.897064 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:14.919274 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7401741 May 20 20:38:14.936609 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Request body: {'port': {'device_id': '5a50057a-1b2f-40da-b79b-6236556c116e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:15.054822 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:15.109175 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:15.317613 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c16a9e9-2775-43b9-9d82-6b047c8af62f req-24642446-fbab-4e5b-a117-927e1e80d3dd tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:15.319066 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c16a9e9-2775-43b9-9d82-6b047c8af62f req-24642446-fbab-4e5b-a117-927e1e80d3dd tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 932 time: 0.0872221 May 20 20:38:15.366004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-4c16a9e9-2775-43b9-9d82-6b047c8af62f req-36c9ce5a-1d7d-4e9a-8272-2488a3262b50 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Synchronizing usage tracker for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:38:15.386256 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-4c16a9e9-2775-43b9-9d82-6b047c8af62f req-36c9ce5a-1d7d-4e9a-8272-2488a3262b50 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Unset dirty status for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:38:15.388739 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4c16a9e9-2775-43b9-9d82-6b047c8af62f req-36c9ce5a-1d7d-4e9a-8272-2488a3262b50 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631776 May 20 20:38:15.397174 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756a116e-12be-49ad-95a3-ac8e7c3762d3 req-6ac439d9-caab-4aea-8ee6-bd24c6d498d9 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:15.398923 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-756a116e-12be-49ad-95a3-ac8e7c3762d3 req-6ac439d9-caab-4aea-8ee6-bd24c6d498d9 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 950 time: 0.2136443 May 20 20:38:15.468161 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-756a116e-12be-49ad-95a3-ac8e7c3762d3 req-3bb75934-abaa-45e1-bb39-e5f42a8ccd41 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616348 May 20 20:38:15.548616 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 45b552b1-7e9b-48e3-a3b3-315f9589e694 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:38:15.557895 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:15.574248 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Transition to ACTIVE for port object 45b552b1-7e9b-48e3-a3b3-315f9589e694 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:38:15.577563 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:15.581451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7f2ab4e4-5d89-4869-9198-dedd5bd7f5f4 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:15.738193 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Pushing event updated for resources: {'Port': ['ID=45b552b1-7e9b-48e3-a3b3-315f9589e694,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:15.741523 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:15.813988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Attempting to bind port 45b552b1-7e9b-48e3-a3b3-315f9589e694 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:38:15.814321 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Attempting to bind port 45b552b1-7e9b-48e3-a3b3-315f9589e694 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:38:15.814660 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Attempting to bind port 45b552b1-7e9b-48e3-a3b3-315f9589e694 on network 04cb5cea-2512-4ea7-983d-27ece528e16b {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:38:15.819210 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Port 45b552b1-7e9b-48e3-a3b3-315f9589e694 on network 04cb5cea-2512-4ea7-983d-27ece528e16b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:38:15.819525 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Attempting to bind port 45b552b1-7e9b-48e3-a3b3-315f9589e694 on network 04cb5cea-2512-4ea7-983d-27ece528e16b {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:38:15.824704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 38, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:38:15.825326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Checking segment: {'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:38:15.825510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Bound using segment: {'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:38:15.825929 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Bound port: 45b552b1-7e9b-48e3-a3b3-315f9589e694, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:38:15.826272 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:16.019779 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] For port 45b552b1-7e9b-48e3-a3b3-315f9589e694, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:38:16.022796 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] For port 45b552b1-7e9b-48e3-a3b3-315f9589e694, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=45b552b1-7e9b-48e3-a3b3-315f9589e694,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:38:16.028173 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:16.032795 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b56fedb3-78de-4e48-8719-53adcd256470 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:16.090888 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:16.091495 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:16.092900 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] 10.222.0.69 "PUT /v2.0/ports/45b552b1-7e9b-48e3-a3b3-315f9589e694 HTTP/1.1" status: 200 len: 1094 time: 1.1604717 May 20 20:38:16.093396 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5a50057a-1b2f-40da-b79b-6236556c116e', 'tag': '45b552b1-7e9b-48e3-a3b3-315f9589e694'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:16.114256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Pushing event updated for resources: {'Port': ['ID=45b552b1-7e9b-48e3-a3b3-315f9589e694,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:16.117239 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:16.145016 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5a50057a-1b2f-40da-b79b-6236556c116e', 'tag': '45b552b1-7e9b-48e3-a3b3-315f9589e694', 'status': 'completed', 'code': 200} May 20 20:38:16.281877 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-a9638ba7-da16-4c1c-9c24-3244961ee53e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:16.283342 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-a9638ba7-da16-4c1c-9c24-3244961ee53e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=5680b3ebd9354a18b1440cc2199ddbac&device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 1097 time: 0.1375582 May 20 20:38:16.295939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-9912f3a2-bd62-4846-ac92-85b6b6bc9156 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:16.297477 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-9912f3a2-bd62-4846-ac92-85b6b6bc9156 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.69 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 950 time: 0.1078415 May 20 20:38:16.397163 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-f4dd620b-2a0f-470f-b187-cf19dca8b0b8 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=45b552b1-7e9b-48e3-a3b3-315f9589e694 HTTP/1.1" status: 200 len: 217 time: 0.0986741 May 20 20:38:16.563030 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-3d999059-38cb-4871-bded-9fa6b1cc89e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:16.564509 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-3d999059-38cb-4871-bded-9fa6b1cc89e1 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f HTTP/1.1" status: 200 len: 849 time: 0.1545062 May 20 20:38:16.632927 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-988db2b8-6a5f-49ea-b902-46620ffa1eb5 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=04cb5cea-2512-4ea7-983d-27ece528e16b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0526404 May 20 20:38:16.663789 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b14547-18b8-4a3a-9131-6bc8e6985b3d req-fb3e55f3-2337-4667-93d4-be5d4f46332e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:16.665611 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-90b14547-18b8-4a3a-9131-6bc8e6985b3d req-fb3e55f3-2337-4667-93d4-be5d4f46332e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 950 time: 0.0804653 May 20 20:38:16.671517 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Deleting port 29bcba98-92ef-46bd-986e-f7ffbcc3057c {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:38:16.671901 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:16.711439 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-90b14547-18b8-4a3a-9131-6bc8e6985b3d req-47011f1e-41de-4cdf-be38-b3c0d9806973 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/security-groups?id=deaa68ab-d108-4bdd-964f-323bb211aa60&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390732 May 20 20:38:16.782631 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537ce528-0a80-4a3a-8d83-fbc9a38fb269 req-484239e7-02de-48b1-a0d2-ecb00b6a1ee7 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:16.783228 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-537ce528-0a80-4a3a-8d83-fbc9a38fb269 req-484239e7-02de-48b1-a0d2-ecb00b6a1ee7 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Synchronizing usage tracker for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:38:16.889232 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-537ce528-0a80-4a3a-8d83-fbc9a38fb269 req-484239e7-02de-48b1-a0d2-ecb00b6a1ee7 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Unset dirty status for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:38:16.890369 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-537ce528-0a80-4a3a-8d83-fbc9a38fb269 req-484239e7-02de-48b1-a0d2-ecb00b6a1ee7 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 944 time: 0.3858871 May 20 20:38:16.941097 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-7a26ebc6-68f1-469e-bf3a-b0bd7ab021ff service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2948272 May 20 20:38:16.950038 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] For port 29bcba98-92ef-46bd-986e-f7ffbcc3057c, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=29bcba98-92ef-46bd-986e-f7ffbcc3057c,segment=NetworkSegment(86f13d3e-0be6-42ff-b615-3d835f455446),segment_id=86f13d3e-0be6-42ff-b615-3d835f455446)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:16.950393 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:17.104850 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-537ce528-0a80-4a3a-8d83-fbc9a38fb269 req-2666f890-20d9-4734-a411-adb934d94a70 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2024591 May 20 20:38:17.120859 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Calling delete_port for 29bcba98-92ef-46bd-986e-f7ffbcc3057c owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:38:17.236583 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4489c979-f92a-4d5e-9c1b-ab1d098a02fd req-258ea2fe-f925-4371-81f6-7ad16b23781b service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2676790 May 20 20:38:17.369243 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:17.375689 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-fd0a7433-f9ac-40cb-9f33-e820f6eb4ff1 tempest-TestShelveInstance-412993845 tempest-TestShelveInstance-412993845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:17.386549 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['29bcba98-92ef-46bd-986e-f7ffbcc3057c'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:38:17.426819 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Pushing event deleted for resources: {'Port': ['ID=29bcba98-92ef-46bd-986e-f7ffbcc3057c,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:17.454451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:17.616180 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-3851f525-ff59-4244-8d11-18ac80a803b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:17.617634 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-3851f525-ff59-4244-8d11-18ac80a803b3 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=5680b3ebd9354a18b1440cc2199ddbac&device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 1097 time: 0.3154972 May 20 20:38:17.623531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] No DVR routers for this DVR port 29bcba98-92ef-46bd-986e-f7ffbcc3057c on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:38:17.626088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:17.667131 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8af7dac6-0e08-482a-8a83-610fb1d3b755 req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.69 "DELETE /v2.0/ports/29bcba98-92ef-46bd-986e-f7ffbcc3057c HTTP/1.1" status: 204 len: 173 time: 1.3222151 May 20 20:38:17.764118 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-3ede44a5-0f48-46d0-86fc-e406da6fa27c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:17.765589 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-3ede44a5-0f48-46d0-86fc-e406da6fa27c service neutron] 10.222.0.69 "GET /v2.0/networks?id=04cb5cea-2512-4ea7-983d-27ece528e16b HTTP/1.1" status: 200 len: 910 time: 0.1327310 May 20 20:38:17.844010 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-5a0e2d27-0cea-4b86-a471-4491a9b00cc2 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=45b552b1-7e9b-48e3-a3b3-315f9589e694 HTTP/1.1" status: 200 len: 217 time: 0.0662286 May 20 20:38:17.886087 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-17ed6c81-109e-4721-92dd-79eb0b498266 req-250f2d80-ec0a-4af3-9701-4b24133b9e7e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] 10.222.0.82 "GET /v2.0/ports?device_id=d9399e73-3bd0-40de-a919-ed6be4ee3164 HTTP/1.1" status: 200 len: 210 time: 0.0493109 May 20 20:38:17.915158 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-4b22b87b-9f83-4bfd-b39d-4100cdf48100 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:17.916617 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-4b22b87b-9f83-4bfd-b39d-4100cdf48100 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f HTTP/1.1" status: 200 len: 849 time: 0.0578294 May 20 20:38:17.966142 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-e3216405-3357-4420-84c6-8dee4275961f service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=04cb5cea-2512-4ea7-983d-27ece528e16b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0398915 May 20 20:38:18.109406 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-e3c56351-c0af-47a3-aa83-14c74d8f005b service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261599 May 20 20:38:18.146103 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'name': 'network-vif-deleted', 'tag': '29bcba98-92ef-46bd-986e-f7ffbcc3057c'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:18.214279 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9399e73-3bd0-40de-a919-ed6be4ee3164', 'name': 'network-vif-deleted', 'tag': '29bcba98-92ef-46bd-986e-f7ffbcc3057c', 'status': 'completed', 'code': 200} May 20 20:38:18.313378 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d5878a3c-2618-4693-b9ac-408e411f5515 req-26bf5d15-c973-44a7-8483-6e50cd388b4b service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1901343 May 20 20:38:18.333725 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24056257-d2f3-4ea9-983f-7f50696a53f8 req-37d7d6fc-9148-48a1-baaf-faec8fe53726 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:18.335388 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24056257-d2f3-4ea9-983f-7f50696a53f8 req-37d7d6fc-9148-48a1-baaf-faec8fe53726 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 944 time: 0.1164658 May 20 20:38:18.380355 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24056257-d2f3-4ea9-983f-7f50696a53f8 req-56621025-f499-4c9e-8b61-00aed73f1d3e tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390959 May 20 20:38:19.576674 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59e2f6e7-5b01-491b-8654-902e26ce1b4c req-c911fe09-3f3f-4479-a2ee-875e9bfe9049 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:19.578124 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-59e2f6e7-5b01-491b-8654-902e26ce1b4c req-c911fe09-3f3f-4479-a2ee-875e9bfe9049 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 944 time: 0.0865095 May 20 20:38:19.624748 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-59e2f6e7-5b01-491b-8654-902e26ce1b4c req-af9af8d0-afb7-477c-bd0e-25b2371bab61 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408609 May 20 20:38:20.231340 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 45b552b1-7e9b-48e3-a3b3-315f9589e694 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:38:20.234813 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 29bcba98-92ef-46bd-986e-f7ffbcc3057c no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:38:20.274005 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 29bcba98-92ef-46bd-986e-f7ffbcc3057c {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:38:20.274347 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 29bcba98-92ef-46bd-986e-f7ffbcc3057c not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:38:20.403680 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 45b552b1-7e9b-48e3-a3b3-315f9589e694, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=45b552b1-7e9b-48e3-a3b3-315f9589e694,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:20.419989 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '45b552b1-7e9b-48e3-a3b3-315f9589e694', 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b', 'port_id': '45b552b1-7e9b-48e3-a3b3-315f9589e694', 'mac_address': 'fa:16:3e:34:9f:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 838, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:38:20.477255 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:20.495581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 45b552b1-7e9b-48e3-a3b3-315f9589e694 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:38:20.513180 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 45b552b1-7e9b-48e3-a3b3-315f9589e694, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=45b552b1-7e9b-48e3-a3b3-315f9589e694,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:20.517175 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:20.519422 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:20.590242 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=45b552b1-7e9b-48e3-a3b3-315f9589e694,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:20.593402 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:20.820175 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0686601-7a96-4ab1-a3f2-205d68bed3bc req-4133409e-460f-41da-93e3-63a1c8ae0064 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:20.821747 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e0686601-7a96-4ab1-a3f2-205d68bed3bc req-4133409e-460f-41da-93e3-63a1c8ae0064 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 945 time: 0.0838051 May 20 20:38:20.845722 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['45b552b1-7e9b-48e3-a3b3-315f9589e694'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:38:20.876531 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e0686601-7a96-4ab1-a3f2-205d68bed3bc req-98043a0d-4126-4618-8ca4-d0ddd67957ff tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487621 May 20 20:38:22.062062 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4306a96-368a-49f0-88b9-0722ddb1066c req-39fb3360-2f80-4c8c-8c7e-d85590ab68f5 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:22.063542 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a4306a96-368a-49f0-88b9-0722ddb1066c req-39fb3360-2f80-4c8c-8c7e-d85590ab68f5 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 945 time: 0.0828333 May 20 20:38:22.116888 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a4306a96-368a-49f0-88b9-0722ddb1066c req-9d874c3b-88fc-4450-b7f3-be2451b251ab tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445976 May 20 20:38:22.258881 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 45b552b1-7e9b-48e3-a3b3-315f9589e694 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:38:22.327960 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 45b552b1-7e9b-48e3-a3b3-315f9589e694 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:38:22.332332 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 45b552b1-7e9b-48e3-a3b3-315f9589e694 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:38:22.332752 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:22.452227 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:22.479734 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5a50057a-1b2f-40da-b79b-6236556c116e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45b552b1-7e9b-48e3-a3b3-315f9589e694'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:22.489685 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 45b552b1-7e9b-48e3-a3b3-315f9589e694, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=45b552b1-7e9b-48e3-a3b3-315f9589e694,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:22.493686 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:22.502043 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:22.538400 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5a50057a-1b2f-40da-b79b-6236556c116e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45b552b1-7e9b-48e3-a3b3-315f9589e694', 'code': 200} May 20 20:38:22.574072 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=45b552b1-7e9b-48e3-a3b3-315f9589e694,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:22.577849 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:22.807852 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b35ca8e1-efcc-47be-8c7f-a48c09e118fe req-75e78f97-4423-4935-a761-56662ca2b370 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:22.809234 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b35ca8e1-efcc-47be-8c7f-a48c09e118fe req-75e78f97-4423-4935-a761-56662ca2b370 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 1099 time: 0.0704844 May 20 20:38:22.856191 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b35ca8e1-efcc-47be-8c7f-a48c09e118fe req-69e60086-596d-47ee-a173-b0c69ff83dc0 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0346575 May 20 20:38:23.307244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4edd3d-8b2c-4c38-8630-a5db57917b37 req-b5c3f073-2097-430d-ace7-d9f18ea04106 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:23.308779 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b4edd3d-8b2c-4c38-8630-a5db57917b37 req-b5c3f073-2097-430d-ace7-d9f18ea04106 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 946 time: 0.0875175 May 20 20:38:23.354366 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8b4edd3d-8b2c-4c38-8630-a5db57917b37 req-286830a9-5169-45da-afa1-7cc423b80474 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399308 May 20 20:38:23.471108 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 46118) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:38:23.618482 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-66e162cb-0649-41d9-89cd-577489108ee4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0ee77cf7f16d460bbdac8d9537d84e36&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1461637 May 20 20:38:23.621169 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 46124) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:38:23.677972 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a70867d9-a2b0-4423-a99e-9095368b679a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:23.702783 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a70867d9-a2b0-4423-a99e-9095368b679a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:23.757010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a70867d9-a2b0-4423-a99e-9095368b679a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:23.760910 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-afb42368-28e2-4f66-bb9d-99e997c798be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:23.773913 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a70867d9-a2b0-4423-a99e-9095368b679a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=deaa68ab-d108-4bdd-964f-323bb211aa60,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:23.778620 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a70867d9-a2b0-4423-a99e-9095368b679a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:23.788159 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a70867d9-a2b0-4423-a99e-9095368b679a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:23.789286 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a70867d9-a2b0-4423-a99e-9095368b679a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/deaa68ab-d108-4bdd-964f-323bb211aa60 HTTP/1.1" status: 204 len: 168 time: 0.1670978 May 20 20:38:24.545628 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8a3c44-d01f-482b-985e-b0660559554d req-e424276a-d7b3-41e5-8093-b3ade6b78718 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:24.547033 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9b8a3c44-d01f-482b-985e-b0660559554d req-e424276a-d7b3-41e5-8093-b3ade6b78718 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 946 time: 0.0855048 May 20 20:38:24.592044 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9b8a3c44-d01f-482b-985e-b0660559554d req-300a21bf-c683-4199-8b2e-3b0ff121729b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392387 May 20 20:38:25.828274 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f631acd-8046-45ce-ae17-47ef8c9d770a req-ed71c7c3-f4fe-4abd-abce-75b3056c13a4 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:25.829982 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5f631acd-8046-45ce-ae17-47ef8c9d770a req-ed71c7c3-f4fe-4abd-abce-75b3056c13a4 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 946 time: 0.0843523 May 20 20:38:25.875913 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5f631acd-8046-45ce-ae17-47ef8c9d770a req-16f47dc8-8b06-4c9d-9c76-376c63acb89b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404971 May 20 20:38:27.206776 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b91f64-7c8a-4b67-bbc7-7d7f0896ea1a req-1cec9d36-2635-4e27-af36-297be9cf73ce tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:27.208188 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-80b91f64-7c8a-4b67-bbc7-7d7f0896ea1a req-1cec9d36-2635-4e27-af36-297be9cf73ce tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 946 time: 0.0816486 May 20 20:38:27.253081 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-80b91f64-7c8a-4b67-bbc7-7d7f0896ea1a req-20354c49-ae36-4fa1-9050-b3f4f431c21d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391376 May 20 20:38:28.001579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-83fa4d1a-050e-4e60-a094-639489775e76 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:28.002981 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-83fa4d1a-050e-4e60-a094-639489775e76 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 946 time: 0.0829787 May 20 20:38:28.146038 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Deleting port 45b552b1-7e9b-48e3-a3b3-315f9589e694 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:38:28.146367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:28.374928 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] For port 45b552b1-7e9b-48e3-a3b3-315f9589e694, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=45b552b1-7e9b-48e3-a3b3-315f9589e694,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:28.375612 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:28.444862 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa9db27-a4f2-42db-84a3-2828b4b06d16 req-619a0195-d42d-4e39-a7ec-72ef302a4771 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:28.446331 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1aa9db27-a4f2-42db-84a3-2828b4b06d16 req-619a0195-d42d-4e39-a7ec-72ef302a4771 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=5a50057a-1b2f-40da-b79b-6236556c116e HTTP/1.1" status: 200 len: 946 time: 0.0838940 May 20 20:38:28.492929 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1aa9db27-a4f2-42db-84a3-2828b4b06d16 req-cf13e982-35e2-4347-880b-adc4a97c4121 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396919 May 20 20:38:28.496238 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Calling delete_port for 45b552b1-7e9b-48e3-a3b3-315f9589e694 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:38:28.604788 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:28.610159 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-778eaa00-2a74-41d2-8b2f-d88b884b1411 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:28.621546 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['45b552b1-7e9b-48e3-a3b3-315f9589e694'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:38:28.659169 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Pushing event deleted for resources: {'Port': ['ID=45b552b1-7e9b-48e3-a3b3-315f9589e694,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:28.686145 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:28.732133 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] No DVR routers for this DVR port 45b552b1-7e9b-48e3-a3b3-315f9589e694 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:38:28.734789 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:28.737485 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5a50057a-1b2f-40da-b79b-6236556c116e', 'name': 'network-vif-deleted', 'tag': '45b552b1-7e9b-48e3-a3b3-315f9589e694'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:28.755027 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-17970fb4-1574-4340-bb74-e2a708ebb7ba req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "DELETE /v2.0/ports/45b552b1-7e9b-48e3-a3b3-315f9589e694 HTTP/1.1" status: 204 len: 173 time: 0.7393060 May 20 20:38:28.981467 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5a50057a-1b2f-40da-b79b-6236556c116e', 'name': 'network-vif-deleted', 'tag': '45b552b1-7e9b-48e3-a3b3-315f9589e694', 'status': 'completed', 'code': 200} May 20 20:38:29.908823 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-1ca221bb-d46a-4c23-94e9-175ad159c152 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:29.910235 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-1ca221bb-d46a-4c23-94e9-175ad159c152 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/networks?id=04cb5cea-2512-4ea7-983d-27ece528e16b HTTP/1.1" status: 200 len: 809 time: 0.1462195 May 20 20:38:29.925242 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-513321d8-fdfb-4a83-99c2-7201e4b60e8e tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/quotas/5680b3ebd9354a18b1440cc2199ddbac HTTP/1.1" status: 200 len: 375 time: 0.0095620 May 20 20:38:29.971627 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-0bfb73d3-35c3-454a-890b-3cf527825be2 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Synchronizing usage tracker for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:38:29.987431 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-0bfb73d3-35c3-454a-890b-3cf527825be2 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Unset dirty status for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:38:29.988771 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-0bfb73d3-35c3-454a-890b-3cf527825be2 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=5680b3ebd9354a18b1440cc2199ddbac&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0582581 May 20 20:38:30.125456 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-61f7d67f-2645-45f6-a2ee-9b16828450ac service neutron] 10.222.0.82 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1285982 May 20 20:38:30.258235 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-c94d11e4-8c79-4a90-b8c9-5ba6161341c5 service neutron] 10.222.0.82 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269696 May 20 20:38:30.430830 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b1e08f01-7579-4fe2-a0d3-1a81dd66b882 req-337a0ce6-1af9-415a-9e1b-41fdee2c26f7 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 210 time: 0.0439053 May 20 20:38:31.525623 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-60f8e080-9a14-481f-9039-8b43f362cae6 req-54736c39-77f8-4a81-b352-8a73f51c71fe tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 210 time: 0.0442586 May 20 20:38:31.809769 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:38:32.294366 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 45b552b1-7e9b-48e3-a3b3-315f9589e694 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:38:32.328225 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 45b552b1-7e9b-48e3-a3b3-315f9589e694 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:38:32.328565 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 45b552b1-7e9b-48e3-a3b3-315f9589e694 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:38:32.678288 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-286fa3b0-09bd-4038-a2ad-846a1e405298 req-8cea08ac-6f92-48b8-baf7-8c15d5c4ede4 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 210 time: 0.0468044 May 20 20:38:33.698642 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8750f725-3723-467d-99d6-ba16a0aff4c6 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:33.700103 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8750f725-3723-467d-99d6-ba16a0aff4c6 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "GET /v2.0/networks?id=04cb5cea-2512-4ea7-983d-27ece528e16b HTTP/1.1" status: 200 len: 809 time: 0.1526535 May 20 20:38:33.719365 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Request body: {'port': {'device_id': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b', 'admin_state_up': True, 'tenant_id': '5680b3ebd9354a18b1440cc2199ddbac'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:33.868787 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-51fa2b53-4240-4ed3-bc1c-ccc65d0264bb req-d99eeb47-84fc-4dd0-941c-10338055da8f tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 210 time: 0.0596206 May 20 20:38:33.903904 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:38:33.913234 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:38:33.923322 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Made reservation on behalf of 5680b3ebd9354a18b1440cc2199ddbac for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:38:33.926773 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:34.183363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Allocated IP 172.20.0.2 (04cb5cea-2512-4ea7-983d-27ece528e16b/df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f/f4543b70-4af1-4b56-a972-92ca157d77af) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:38:34.377858 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:34.406988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:34.413815 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8df-d4c5-4e98-96bc-e501148d6eb0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:34.481054 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Network 04cb5cea-2512-4ea7-983d-27ece528e16b is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:38:34.484389 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:38:34.486798 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:38:34.528514 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Pushing event updated for resources: {'Port': ['ID=f4543b70-4af1-4b56-a972-92ca157d77af,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:34.531272 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:34.559051 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:34.559655 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:34.583366 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-7c22d26f-f08a-4cdd-acb3-04d5433e8816 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8678815 May 20 20:38:34.600779 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Request body: {'port': {'device_id': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:38:34.711861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:34.780187 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-aafd4cf0-22bd-408a-9177-c18dff48d575 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:35.052295 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f4543b70-4af1-4b56-a972-92ca157d77af {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:38:35.055575 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d3e671e-3f60-443b-b58f-0cdf8ceaeb66 req-4b97d53b-8717-470c-9dd4-2af9e6a3735c tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:35.057232 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7d3e671e-3f60-443b-b58f-0cdf8ceaeb66 req-4b97d53b-8717-470c-9dd4-2af9e6a3735c tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 931 time: 0.0808916 May 20 20:38:35.059545 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:35.073809 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Transition to ACTIVE for port object f4543b70-4af1-4b56-a972-92ca157d77af will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:38:35.079243 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:35.083717 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-db1508db-dcb7-4e5f-841f-68068b087008 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:35.105877 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7d3e671e-3f60-443b-b58f-0cdf8ceaeb66 req-7ace85a2-ed57-46e1-bdaf-4a98a6abbda7 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428634 May 20 20:38:35.243246 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Pushing event updated for resources: {'Port': ['ID=f4543b70-4af1-4b56-a972-92ca157d77af,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:35.269487 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:35.311101 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Attempting to bind port f4543b70-4af1-4b56-a972-92ca157d77af on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:38:35.311343 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Attempting to bind port f4543b70-4af1-4b56-a972-92ca157d77af by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:38:35.311663 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Attempting to bind port f4543b70-4af1-4b56-a972-92ca157d77af on network 04cb5cea-2512-4ea7-983d-27ece528e16b {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:38:35.316188 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Port f4543b70-4af1-4b56-a972-92ca157d77af on network 04cb5cea-2512-4ea7-983d-27ece528e16b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:38:35.316504 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Attempting to bind port f4543b70-4af1-4b56-a972-92ca157d77af on network 04cb5cea-2512-4ea7-983d-27ece528e16b {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:38:35.321522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 38, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:38:35.322378 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Checking segment: {'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:38:35.322763 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Bound using segment: {'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:38:35.323177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Bound port: f4543b70-4af1-4b56-a972-92ca157d77af, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ec46f2ff-374c-45cf-be53-dce114a8ec8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:38:35.323518 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:35.414199 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] For port f4543b70-4af1-4b56-a972-92ca157d77af, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:38:35.417245 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] For port f4543b70-4af1-4b56-a972-92ca157d77af, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f4543b70-4af1-4b56-a972-92ca157d77af,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:38:35.421828 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:35.426140 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:35.480625 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:35.481232 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:35.482586 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] 10.222.0.69 "PUT /v2.0/ports/f4543b70-4af1-4b56-a972-92ca157d77af HTTP/1.1" status: 200 len: 1093 time: 0.8859513 May 20 20:38:35.483082 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'tag': 'f4543b70-4af1-4b56-a972-92ca157d77af'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:35.506012 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Pushing event updated for resources: {'Port': ['ID=f4543b70-4af1-4b56-a972-92ca157d77af,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:35.508993 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:35.530979 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'tag': 'f4543b70-4af1-4b56-a972-92ca157d77af', 'status': 'completed', 'code': 200} May 20 20:38:35.614695 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-183a3457-a652-4bf6-8d6e-4a22f06b9f04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:35.616184 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-183a3457-a652-4bf6-8d6e-4a22f06b9f04 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=5680b3ebd9354a18b1440cc2199ddbac&device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 1096 time: 0.0736930 May 20 20:38:35.690324 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-8fec2fd9-bd12-4258-b27c-2d68618c80dc service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f4543b70-4af1-4b56-a972-92ca157d77af HTTP/1.1" status: 200 len: 217 time: 0.0603256 May 20 20:38:35.761442 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-2315de68-4359-4cb0-bd06-6cef091d6372 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:35.762934 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-2315de68-4359-4cb0-bd06-6cef091d6372 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f HTTP/1.1" status: 200 len: 849 time: 0.0608337 May 20 20:38:35.814756 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-2a5c5338-49b9-42f4-b02e-c2c3d7b4adba service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=04cb5cea-2512-4ea7-983d-27ece528e16b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0418499 May 20 20:38:36.045925 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-1d49afce-a4b9-4ec9-b19a-b9289ede1731 service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2173808 May 20 20:38:36.182493 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-43be7731-cd00-4e0f-9cbe-d4f71351b306 req-3fa975b9-468d-46ac-b0a1-2eb0e968a78d service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242578 May 20 20:38:36.308029 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8099399-4283-4985-b4df-11a8831bf24d req-9f7cd42e-9db8-40c8-8802-d311b591851c tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:36.309494 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b8099399-4283-4985-b4df-11a8831bf24d req-9f7cd42e-9db8-40c8-8802-d311b591851c tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 943 time: 0.0848522 May 20 20:38:36.319279 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-62275c12-b1d7-4022-b70b-9191eaa11852 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:36.320751 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-62275c12-b1d7-4022-b70b-9191eaa11852 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=5680b3ebd9354a18b1440cc2199ddbac&device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 1096 time: 0.0717218 May 20 20:38:36.354838 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-b8099399-4283-4985-b4df-11a8831bf24d req-247b3da8-9498-4cdf-8f2b-794d727b32ba tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395412 May 20 20:38:36.458790 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-52287e61-4856-47f2-ad2f-7e2a78036578 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:36.460363 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-52287e61-4856-47f2-ad2f-7e2a78036578 service neutron] 10.222.0.69 "GET /v2.0/networks?id=04cb5cea-2512-4ea7-983d-27ece528e16b HTTP/1.1" status: 200 len: 910 time: 0.1276770 May 20 20:38:36.538760 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-96a53784-d5b6-47a9-9c85-a69604e55252 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f4543b70-4af1-4b56-a972-92ca157d77af HTTP/1.1" status: 200 len: 217 time: 0.0650842 May 20 20:38:36.606383 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-9c4f7421-7c93-422f-abdc-398660589732 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:36.607839 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-9c4f7421-7c93-422f-abdc-398660589732 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f HTTP/1.1" status: 200 len: 849 time: 0.0585871 May 20 20:38:36.665481 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-14643bed-506d-4034-8023-258137c0018e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=04cb5cea-2512-4ea7-983d-27ece528e16b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0435703 May 20 20:38:36.802973 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-00e3226d-aee2-4994-85cd-e1238abc9965 service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1242113 May 20 20:38:36.942107 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b792b007-f8ac-4c9f-b009-86a0dd49876e req-32b59ff3-1ea1-4adc-a2dc-fdc95fc6a793 service neutron] 10.222.0.69 "GET /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1257544 May 20 20:38:37.218499 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:37.506008 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8a9cf361-c628-4031-98f8-f4c6bc6d1199 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:37.543194 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94ed6815-ecb3-451b-b795-04b5a43ba87c req-a8d83c0a-3cd5-4cdd-8167-ef06c51c55c1 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:37.543925 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-94ed6815-ecb3-451b-b795-04b5a43ba87c req-a8d83c0a-3cd5-4cdd-8167-ef06c51c55c1 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Synchronizing usage tracker for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:38:37.558832 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-94ed6815-ecb3-451b-b795-04b5a43ba87c req-a8d83c0a-3cd5-4cdd-8167-ef06c51c55c1 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Unset dirty status for tenant:5680b3ebd9354a18b1440cc2199ddbac on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:38:37.559985 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-94ed6815-ecb3-451b-b795-04b5a43ba87c req-a8d83c0a-3cd5-4cdd-8167-ef06c51c55c1 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 943 time: 0.0982196 May 20 20:38:37.605397 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-94ed6815-ecb3-451b-b795-04b5a43ba87c req-2de8976d-2c7e-4d02-adbb-b340ce8a5ad0 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395396 May 20 20:38:38.310307 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f4543b70-4af1-4b56-a972-92ca157d77af details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:38:38.327213 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:38.450826 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port f4543b70-4af1-4b56-a972-92ca157d77af, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f4543b70-4af1-4b56-a972-92ca157d77af,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:38.463755 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': 'f4543b70-4af1-4b56-a972-92ca157d77af', 'network_id': '04cb5cea-2512-4ea7-983d-27ece528e16b', 'port_id': 'f4543b70-4af1-4b56-a972-92ca157d77af', 'mac_address': 'fa:16:3e:9f:5d:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 838, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:38:38.519367 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:38.538621 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f4543b70-4af1-4b56-a972-92ca157d77af {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:38:38.554317 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port f4543b70-4af1-4b56-a972-92ca157d77af, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f4543b70-4af1-4b56-a972-92ca157d77af,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:38.560543 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:38.562831 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-757c9ee1-eef7-4f32-9c6e-804a76d11ebd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:38.628056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=f4543b70-4af1-4b56-a972-92ca157d77af,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:38.635585 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.635951 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.636286 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.636620 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.636941 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.637262 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.637581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.637902 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.638218 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.638532 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.638843 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.639156 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:38:38.643089 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:38.789406 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65485429-d38b-4f8c-8e76-34dcfc4bb4f6 req-40c1b13c-11c2-4deb-b185-27b1fdd720f2 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:38.791395 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-65485429-d38b-4f8c-8e76-34dcfc4bb4f6 req-40c1b13c-11c2-4deb-b185-27b1fdd720f2 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 944 time: 0.0795569 May 20 20:38:38.839925 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-65485429-d38b-4f8c-8e76-34dcfc4bb4f6 req-85e6a239-7c32-4654-b8bc-3835683c9605 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422163 May 20 20:38:38.903256 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['f4543b70-4af1-4b56-a972-92ca157d77af'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:38:39.929146 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:40.027481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45fdf92-beee-4dec-97d4-2d1f68337c22 req-0bb710f5-08c7-4c7f-bec2-eface5ce580b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:40.028942 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b45fdf92-beee-4dec-97d4-2d1f68337c22 req-0bb710f5-08c7-4c7f-bec2-eface5ce580b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 944 time: 0.0819886 May 20 20:38:40.073236 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b45fdf92-beee-4dec-97d4-2d1f68337c22 req-236512df-8170-40cf-ae70-e6178f1b6180 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387082 May 20 20:38:40.324089 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f4543b70-4af1-4b56-a972-92ca157d77af up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:38:40.391025 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port f4543b70-4af1-4b56-a972-92ca157d77af completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:38:40.395720 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port f4543b70-4af1-4b56-a972-92ca157d77af triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:38:40.396124 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:40.517217 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:40.544923 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4543b70-4af1-4b56-a972-92ca157d77af'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:40.555067 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port f4543b70-4af1-4b56-a972-92ca157d77af, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f4543b70-4af1-4b56-a972-92ca157d77af,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:40.560836 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:40.563994 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:40.621880 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4543b70-4af1-4b56-a972-92ca157d77af', 'code': 200} May 20 20:38:40.654186 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=f4543b70-4af1-4b56-a972-92ca157d77af,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:40.657240 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:40.861652 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c146e0fe-fd75-416c-a62f-b4d770d4accc req-1f29d892-4b86-4259-b2c3-41843ad7b64f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:40.863026 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c146e0fe-fd75-416c-a62f-b4d770d4accc req-1f29d892-4b86-4259-b2c3-41843ad7b64f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 1098 time: 0.0707188 May 20 20:38:40.912939 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c146e0fe-fd75-416c-a62f-b4d770d4accc req-ec3d218b-f8c8-4323-b8d7-d90df76dd712 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377688 May 20 20:38:41.256182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80aaa879-a9cd-4229-a98a-757183c51e78 req-4bbb97b1-f354-4b81-a79f-db66816e7262 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:41.257605 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-80aaa879-a9cd-4229-a98a-757183c51e78 req-4bbb97b1-f354-4b81-a79f-db66816e7262 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 945 time: 0.0781767 May 20 20:38:41.301847 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-80aaa879-a9cd-4229-a98a-757183c51e78 req-e6328555-8ba4-4a37-b1f9-37215f305483 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377774 May 20 20:38:42.485036 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49b7055-cdc1-4fd0-a6ce-8e737ebad532 req-83c156a1-6869-460f-896f-8c1627a78d9a tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:42.486403 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d49b7055-cdc1-4fd0-a6ce-8e737ebad532 req-83c156a1-6869-460f-896f-8c1627a78d9a tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 945 time: 0.0790043 May 20 20:38:42.533426 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d49b7055-cdc1-4fd0-a6ce-8e737ebad532 req-4ef45d4e-55ab-43ac-adc5-b9fdd7fc46fb tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413907 May 20 20:38:43.830667 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4162e08-446a-4f5e-b834-bedb1b6f3de9 req-5116e144-f7fb-4a3f-872a-c25ad1989eef tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:43.832035 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f4162e08-446a-4f5e-b834-bedb1b6f3de9 req-5116e144-f7fb-4a3f-872a-c25ad1989eef tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 945 time: 0.0849679 May 20 20:38:43.876799 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f4162e08-446a-4f5e-b834-bedb1b6f3de9 req-9eaa739d-6645-4684-88a5-9512d99e0915 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390744 May 20 20:38:45.069130 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94cefa49-f605-418c-90dd-036d3cd3c980 req-4ae8502c-7fbc-44b8-b4ec-79ac2b1a9319 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:45.070552 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-94cefa49-f605-418c-90dd-036d3cd3c980 req-4ae8502c-7fbc-44b8-b4ec-79ac2b1a9319 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 945 time: 0.0821972 May 20 20:38:45.114068 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-94cefa49-f605-418c-90dd-036d3cd3c980 req-9fd820ff-1eb2-4406-88f0-ff6b18cd2c82 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376482 May 20 20:38:45.126597 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:46.086197 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-a871a346-43a8-4f6a-8c5f-7f95bf76d48f tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:46.087616 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-a871a346-43a8-4f6a-8c5f-7f95bf76d48f tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 945 time: 0.0794139 May 20 20:38:46.238300 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Deleting port f4543b70-4af1-4b56-a972-92ca157d77af {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:38:46.238670 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:46.452046 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa803fdf-a205-42e4-b974-540b92d6d364 req-b53e063f-a159-4225-b447-c722dad5d791 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:38:46.453529 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-aa803fdf-a205-42e4-b974-540b92d6d364 req-b53e063f-a159-4225-b447-c722dad5d791 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 945 time: 0.0810537 May 20 20:38:46.473352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] For port f4543b70-4af1-4b56-a972-92ca157d77af, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f4543b70-4af1-4b56-a972-92ca157d77af,segment=NetworkSegment(ec46f2ff-374c-45cf-be53-dce114a8ec8d),segment_id=ec46f2ff-374c-45cf-be53-dce114a8ec8d)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:38:46.473630 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:46.500326 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-aa803fdf-a205-42e4-b974-540b92d6d364 req-cb581e65-817a-46ee-be20-8e8ab83d8981 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409658 May 20 20:38:46.600100 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Calling delete_port for f4543b70-4af1-4b56-a972-92ca157d77af owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:38:46.708690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:46.714019 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b915cce-098b-436c-8a86-b7e1b2482d0b tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:38:46.726035 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['f4543b70-4af1-4b56-a972-92ca157d77af'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:38:46.758122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Pushing event deleted for resources: {'Port': ['ID=f4543b70-4af1-4b56-a972-92ca157d77af,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:38:46.761579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:38:46.835271 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] No DVR routers for this DVR port f4543b70-4af1-4b56-a972-92ca157d77af on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:38:46.837769 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:38:46.840387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'name': 'network-vif-deleted', 'tag': 'f4543b70-4af1-4b56-a972-92ca157d77af'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:38:46.856668 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d32e2aa9-30ec-49a8-be3c-86d2e0ef6535 req-cf85ebdf-788e-4935-a039-7ec60b59f0dc tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.69 "DELETE /v2.0/ports/f4543b70-4af1-4b56-a972-92ca157d77af HTTP/1.1" status: 204 len: 173 time: 0.7551711 May 20 20:38:46.888702 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a46d4f9c-8910-40e1-99cb-29f993a337e5', 'name': 'network-vif-deleted', 'tag': 'f4543b70-4af1-4b56-a972-92ca157d77af', 'status': 'completed', 'code': 200} May 20 20:38:47.664056 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-578c8301-0356-4265-a2ef-8b1c85e2e95d req-7bafc89a-239a-4eee-9770-a1d9d9a2d4a7 tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] 10.222.0.82 "GET /v2.0/ports?device_id=a46d4f9c-8910-40e1-99cb-29f993a337e5 HTTP/1.1" status: 200 len: 210 time: 0.0458941 May 20 20:38:50.373137 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f4543b70-4af1-4b56-a972-92ca157d77af no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:38:50.406621 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: f4543b70-4af1-4b56-a972-92ca157d77af {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:38:50.406970 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f4543b70-4af1-4b56-a972-92ca157d77af not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:39:04.794828 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-fa8ba88d-cbfc-4249-9e08-f0a4c401ddb1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:07.236440 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:07.515453 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-338539e4-26e2-4f92-9754-97639c666299 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:08.325501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:08.809636 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:39:09.939208 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:14.625878 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 46462) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:39:14.685145 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Deleting subnet df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:39:14.688053 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:14.738624 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:14.790959 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.033211 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.037063 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f7636ff6-6984-4d44-b975-39331641db58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:15.069968 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:15.078776 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.081686 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.082056 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.082414 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.082768 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.083119 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.083472 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.083847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.084197 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.084541 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.084882 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.085222 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.085561 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.089046 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:15.094410 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-45c478b3-afb5-43bb-a9c8-86123bf9e17e admin admin] 10.222.0.82 "DELETE /v2.0/subnets/df4bd7e3-dbf1-4980-b3b7-3ed9a891c03f HTTP/1.1" status: 204 len: 168 time: 0.4675345 May 20 20:39:15.100811 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 46466) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:39:15.145414 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.207427 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.328873 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.341310 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['04cb5cea-2512-4ea7-983d-27ece528e16b']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:39:15.352827 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ec46f2ff-374c-45cf-be53-dce114a8ec8d') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:39:15.353112 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ec46f2ff-374c-45cf-be53-dce114a8ec8d') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:39:15.364099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.380261 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.386195 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Releasing vlan 838 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:39:15.386585 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:39:15.403046 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:39:15.475787 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.480915 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.483559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-26bfc698-c632-4aef-816b-4d52663c1ffa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:15.503163 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Pushing event deleted for resources: {'Network': ['ID=04cb5cea-2512-4ea7-983d-27ece528e16b,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:15.505728 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] 10.222.0.82 "DELETE /v2.0/networks/04cb5cea-2512-4ea7-983d-27ece528e16b HTTP/1.1" status: 204 len: 168 time: 0.4035738 May 20 20:39:15.506583 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4da232a1-ff00-456c-891e-9505616de573 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:15.675789 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 46472) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:39:15.724004 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-54c4dfa5-b7a6-4abd-870f-b35a86f84c72 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5680b3ebd9354a18b1440cc2199ddbac&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0469956 May 20 20:39:15.726369 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 46476) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:39:15.783909 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.809924 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.863959 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.867580 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-cc6ae502-5443-44c2-95d8-c8d01cfbc380 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:15.880648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:15.890388 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.890756 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.891113 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.891465 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.891832 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.892181 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.892526 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.892868 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.893209 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.893547 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.893881 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.894217 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:39:15.898461 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:15.901753 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:15.902852 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-026a966f-6139-4e74-acc5-a893aef1e81a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9f0a1f41-f9cb-44f5-b97a-cd26b859b1f2 HTTP/1.1" status: 204 len: 168 time: 0.1755977 May 20 20:39:16.633733 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 46500) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:39:16.751412 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1431594425-network', 'tenant_id': '82385255062141d0a88d07f9748c7535'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:39:16.756042 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:39:16.759803 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Usage tracker for resource:network and tenant:82385255062141d0a88d07f9748c7535 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:39:16.763333 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:39:16.769651 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:39:16.779426 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Made reservation on behalf of 82385255062141d0a88d07f9748c7535 for: {'network': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:39:16.781766 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:16.794004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:16.807718 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:39:16.812298 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Usage tracker for resource:security_group_rule and tenant:82385255062141d0a88d07f9748c7535 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:39:16.815077 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:39:16.821580 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:39:16.911902 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:16.916539 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:16.920504 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-27169b61-fcb6-477a-a046-5bb88f3ee7d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:16.955751 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] vlan segment allocate from pool success with {'vlan_id': 805, 'physical_network': 'physnet1'} {{(pid=91645) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:39:16.966265 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:16.970121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:16.973521 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:16.974472 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.segments_db [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Added segment 03635b69-792c-4399-af22-c4fd7e0936fd of type vlan for network 8510eab8-b63f-4b66-869e-57e3608edc12 May 20 20:39:17.006557 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:17.041039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:17.042583 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:17.043624 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:17.047004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:17.157022 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5221565 May 20 20:39:17.160188 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 46506) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:39:17.162669 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Pushing event updated for resources: {'Network': ['ID=8510eab8-b63f-4b66-869e-57e3608edc12,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:17.168180 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Request body: {'subnet': {'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1431594425-subnet', 'tenant_id': '82385255062141d0a88d07f9748c7535', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:39:17.172610 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-438d7df9-e2dc-48ef-8e1e-506f4206333c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:17.175410 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 8510eab8-b63f-4b66-869e-57e3608edc12 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:39:17.175921 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:39:17.178768 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Usage tracker for resource:subnet and tenant:82385255062141d0a88d07f9748c7535 is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:39:17.181798 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:39:17.188092 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:39:17.197772 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Made reservation on behalf of 82385255062141d0a88d07f9748c7535 for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:39:17.200314 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4127911'] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:17.703356 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3178265', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4127925'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:17.707944 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-29d1834a-1e77-406d-8bd0-d4243d609c13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:17.785081 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Pushing event updated for resources: {'Subnet': ['ID=7d63d754-5113-4c20-a4d0-ea2f48de8d9d,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:17.788858 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:17.789700 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Checking segment: {'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:39:17.790045 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Network hostable DHCP agents. Network: 8510eab8-b63f-4b66-869e-57e3608edc12, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:39:17.808031 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Network 8510eab8-b63f-4b66-869e-57e3608edc12 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:39:17.823268 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 8510eab8-b63f-4b66-869e-57e3608edc12) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:39:17.826773 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:17.827345 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:17.829403 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59889ff2-0ee6-41be-8e1c-9ee94f3ee812 None None] Network 8510eab8-b63f-4b66-869e-57e3608edc12 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:39:17.848252 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-a666a9a1-2717-4bd9-a101-f135777f3d7f admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6866798 May 20 20:39:18.024009 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2066478-f8f8-482d-8498-df9bf3376d71 None None] Network 8510eab8-b63f-4b66-869e-57e3608edc12 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:39:19.867243 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324775ca-9183-4372-bbda-a312cbded635 req-dce21637-4c9e-4a68-b0e2-662fb8bb38a1 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:19.867945 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-324775ca-9183-4372-bbda-a312cbded635 req-dce21637-4c9e-4a68-b0e2-662fb8bb38a1 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Synchronizing usage tracker for tenant:82385255062141d0a88d07f9748c7535 on resource:network {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:39:19.884764 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-324775ca-9183-4372-bbda-a312cbded635 req-dce21637-4c9e-4a68-b0e2-662fb8bb38a1 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Unset dirty status for tenant:82385255062141d0a88d07f9748c7535 on resource:network {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:39:19.886188 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-dce21637-4c9e-4a68-b0e2-662fb8bb38a1 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 814 time: 0.1637793 May 20 20:39:19.901509 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-0cb84e28-e988-45a3-93cb-67f7668f1e2a tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/quotas/82385255062141d0a88d07f9748c7535 HTTP/1.1" status: 200 len: 375 time: 0.0089397 May 20 20:39:19.948406 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-b76fa884-7753-4ceb-8a68-c15223deca83 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0418122 May 20 20:39:20.001608 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-6e12664f-44c1-45f5-99a5-ecb63133d642 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91645) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:39:20.002587 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-6e12664f-44c1-45f5-99a5-ecb63133d642 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0471504 May 20 20:39:20.134322 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-bddfc0f4-2d9a-4f70-a104-d6052c125f3c service neutron] 10.222.0.82 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257012 May 20 20:39:20.267014 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-42cdd2a3-6f97-4760-b005-69d863b52100 service neutron] 10.222.0.82 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1267133 May 20 20:39:20.447527 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-35d4b746-9cff-4fc7-91c6-4bc7a700da46 req-b44f7eb2-d84d-48ad-9630-2418084f0cd9 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 210 time: 0.0488105 May 20 20:39:21.614390 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4e753ac8-2024-484f-b552-6f07f5c0e8ae req-c9feb709-294e-4ea2-81fa-8d953db3530e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 210 time: 0.0474024 May 20 20:39:21.939859 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324775ca-9183-4372-bbda-a312cbded635 req-ce8bb5b2-694f-4a91-a697-6f3a418796bb tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:21.941290 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-ce8bb5b2-694f-4a91-a697-6f3a418796bb tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 814 time: 0.2421317 May 20 20:39:21.961145 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Request body: {'port': {'device_id': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12', 'admin_state_up': True, 'tenant_id': '82385255062141d0a88d07f9748c7535'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:39:22.098820 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:39:22.102592 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Usage tracker for resource:port and tenant:82385255062141d0a88d07f9748c7535 is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:39:22.105949 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:39:22.111704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:39:22.121907 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Made reservation on behalf of 82385255062141d0a88d07f9748c7535 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:39:22.125428 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:22.288155 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Allocated IP 172.20.0.3 (8510eab8-b63f-4b66-869e-57e3608edc12/7d63d754-5113-4c20-a4d0-ea2f48de8d9d/12bae04d-2991-4f75-a674-408e66033598) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:39:22.489713 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:22.519647 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:22.525190 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-09ef1a20-db46-44ad-a629-4accfd6e3f57 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:22.589736 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Network 8510eab8-b63f-4b66-869e-57e3608edc12 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:39:22.592702 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:39:22.596453 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:39:22.629619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Pushing event updated for resources: {'Port': ['ID=12bae04d-2991-4f75-a674-408e66033598,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:22.635751 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:22.664496 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:22.665334 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:22.686761 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7294810 May 20 20:39:22.706007 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Request body: {'port': {'device_id': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:39:22.868459 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:22.896523 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960babf2-5af4-435c-9222-db5b3cdf8063 req-a0609d60-a855-4a83-ab9c-ba3586620c71 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:22.897196 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-960babf2-5af4-435c-9222-db5b3cdf8063 req-a0609d60-a855-4a83-ab9c-ba3586620c71 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Synchronizing usage tracker for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:39:22.968111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-960babf2-5af4-435c-9222-db5b3cdf8063 req-a0609d60-a855-4a83-ab9c-ba3586620c71 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Unset dirty status for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:39:22.969250 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-960babf2-5af4-435c-9222-db5b3cdf8063 req-a0609d60-a855-4a83-ab9c-ba3586620c71 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 931 time: 0.2339299 May 20 20:39:23.099959 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-960babf2-5af4-435c-9222-db5b3cdf8063 req-548d8526-fff1-468f-9c51-037cb666ccab tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931680 May 20 20:39:23.267660 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 12bae04d-2991-4f75-a674-408e66033598 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:39:23.275507 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:23.289984 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Transition to ACTIVE for port object 12bae04d-2991-4f75-a674-408e66033598 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:39:23.294154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:23.297614 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-00985b8e-84e1-444a-b958-e8977b27355e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:23.443731 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Pushing event updated for resources: {'Port': ['ID=12bae04d-2991-4f75-a674-408e66033598,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:23.451661 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:23.523159 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Attempting to bind port 12bae04d-2991-4f75-a674-408e66033598 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:39:23.523386 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Attempting to bind port 12bae04d-2991-4f75-a674-408e66033598 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:39:23.523805 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Attempting to bind port 12bae04d-2991-4f75-a674-408e66033598 on network 8510eab8-b63f-4b66-869e-57e3608edc12 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:39:23.529182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Port 12bae04d-2991-4f75-a674-408e66033598 on network 8510eab8-b63f-4b66-869e-57e3608edc12 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:39:23.529499 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Attempting to bind port 12bae04d-2991-4f75-a674-408e66033598 on network 8510eab8-b63f-4b66-869e-57e3608edc12 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:39:23.535240 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 39, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:39:23.535738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Checking segment: {'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:39:23.536157 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Bound using segment: {'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:39:23.536707 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Bound port: 12bae04d-2991-4f75-a674-408e66033598, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:39:23.537090 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:23.626608 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] For port 12bae04d-2991-4f75-a674-408e66033598, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:39:23.629531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] For port 12bae04d-2991-4f75-a674-408e66033598, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=12bae04d-2991-4f75-a674-408e66033598,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:39:23.634653 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:23.639150 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6265faf7-a948-4bcd-b697-09d39fb1b25d tempest-VolumesActionsTest-187446364 tempest-VolumesActionsTest-187446364-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:23.694804 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:23.695404 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:23.696753 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] 10.222.0.69 "PUT /v2.0/ports/12bae04d-2991-4f75-a674-408e66033598 HTTP/1.1" status: 200 len: 1093 time: 0.9960744 May 20 20:39:23.697247 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'tag': '12bae04d-2991-4f75-a674-408e66033598'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:39:23.720944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Pushing event updated for resources: {'Port': ['ID=12bae04d-2991-4f75-a674-408e66033598,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:23.724057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-885fb0d8-07b1-429f-b013-d3c8385436a0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:23.748191 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'tag': '12bae04d-2991-4f75-a674-408e66033598', 'status': 'completed', 'code': 200} May 20 20:39:23.930792 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324775ca-9183-4372-bbda-a312cbded635 req-540dcf87-e7bb-4255-abb4-2df978d1e521 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:23.932294 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-540dcf87-e7bb-4255-abb4-2df978d1e521 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 1096 time: 0.1720514 May 20 20:39:24.007843 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-1edbcb35-f9d1-404b-9b35-4ad48a88411c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=12bae04d-2991-4f75-a674-408e66033598 HTTP/1.1" status: 200 len: 217 time: 0.0615697 May 20 20:39:24.078764 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324775ca-9183-4372-bbda-a312cbded635 req-adfdd379-02ea-4ff4-8f2a-60dbb86c96d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:24.080220 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-adfdd379-02ea-4ff4-8f2a-60dbb86c96d7 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=7d63d754-5113-4c20-a4d0-ea2f48de8d9d HTTP/1.1" status: 200 len: 854 time: 0.0577734 May 20 20:39:24.138148 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-16469b7e-9fa2-4462-95b1-df8c01f5e246 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8510eab8-b63f-4b66-869e-57e3608edc12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0433788 May 20 20:39:24.325030 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-054ae64b-32fa-46fa-b7e4-bda2d6653bea service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1747236 May 20 20:39:24.342777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f8b64fa-512e-4d9f-a4b5-2f6b3268ca33 req-54a6dcf0-9d5a-4c36-80f1-6f075cc7b251 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:24.344165 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9f8b64fa-512e-4d9f-a4b5-2f6b3268ca33 req-54a6dcf0-9d5a-4c36-80f1-6f075cc7b251 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 943 time: 0.1143239 May 20 20:39:24.473073 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9f8b64fa-512e-4d9f-a4b5-2f6b3268ca33 req-3532eb60-daae-469c-b362-4dcc24c3e398 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103857 May 20 20:39:24.502552 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-324775ca-9183-4372-bbda-a312cbded635 req-1d12b225-a914-44c1-a602-163f10179e24 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1571202 May 20 20:39:24.631223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-c1f041b1-63ef-4c13-8ffe-cfecaf26719a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:24.632804 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-c1f041b1-63ef-4c13-8ffe-cfecaf26719a service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 1096 time: 0.0745573 May 20 20:39:24.767451 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-00cb7064-6a65-4d58-8261-b83507776f7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:24.768835 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-00cb7064-6a65-4d58-8261-b83507776f7f service neutron] 10.222.0.69 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 915 time: 0.1249125 May 20 20:39:24.841616 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-5fad931d-6e57-4aaa-8eef-2ee72353cd2c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=12bae04d-2991-4f75-a674-408e66033598 HTTP/1.1" status: 200 len: 217 time: 0.0588014 May 20 20:39:24.911408 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-616fe9db-54e0-4576-a205-d236fee9dea9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:24.912899 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-616fe9db-54e0-4576-a205-d236fee9dea9 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=7d63d754-5113-4c20-a4d0-ea2f48de8d9d HTTP/1.1" status: 200 len: 854 time: 0.0604479 May 20 20:39:24.965988 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-d6202d85-c011-4ab0-92ef-6c71f911155c service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8510eab8-b63f-4b66-869e-57e3608edc12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0404692 May 20 20:39:25.103690 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-384266e3-da8a-4d34-ab91-9efef6419f85 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240113 May 20 20:39:25.241876 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2fc9426e-ebb5-4c8d-bc07-de9ad6f1b505 req-80754935-9bb6-4590-afdc-d162cf4560f1 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248231 May 20 20:39:25.657347 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72faac36-ce72-454b-8f83-a620e7af5d9a req-e1e2eeb3-b21b-4282-a042-735a047c9e4a tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:25.658808 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-72faac36-ce72-454b-8f83-a620e7af5d9a req-e1e2eeb3-b21b-4282-a042-735a047c9e4a tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 943 time: 0.0787258 May 20 20:39:25.703656 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-72faac36-ce72-454b-8f83-a620e7af5d9a req-482a599d-b79d-4e4f-bce0-1fc26a546411 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Synchronizing usage tracker for tenant:82385255062141d0a88d07f9748c7535 on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:39:25.720543 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-72faac36-ce72-454b-8f83-a620e7af5d9a req-482a599d-b79d-4e4f-bce0-1fc26a546411 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Unset dirty status for tenant:82385255062141d0a88d07f9748c7535 on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:39:25.721814 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-72faac36-ce72-454b-8f83-a620e7af5d9a req-482a599d-b79d-4e4f-bce0-1fc26a546411 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572171 May 20 20:39:26.604097 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 12bae04d-2991-4f75-a674-408e66033598 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:39:26.768619 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 12bae04d-2991-4f75-a674-408e66033598, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=12bae04d-2991-4f75-a674-408e66033598,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:39:26.782381 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '12bae04d-2991-4f75-a674-408e66033598', 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12', 'port_id': '12bae04d-2991-4f75-a674-408e66033598', 'mac_address': 'fa:16:3e:e2:f4:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 805, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7d63d754-5113-4c20-a4d0-ea2f48de8d9d', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:39:26.836931 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:26.854221 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 12bae04d-2991-4f75-a674-408e66033598 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:39:26.869425 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 12bae04d-2991-4f75-a674-408e66033598, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=12bae04d-2991-4f75-a674-408e66033598,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:39:26.874573 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:26.876417 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:26.912769 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5de0bdb8-d745-435a-8bd3-46429c713f60 req-a6adb9de-5311-4575-a963-abe488fa6fa2 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:26.914233 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5de0bdb8-d745-435a-8bd3-46429c713f60 req-a6adb9de-5311-4575-a963-abe488fa6fa2 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 943 time: 0.0868604 May 20 20:39:26.945452 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=12bae04d-2991-4f75-a674-408e66033598,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:26.948674 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:26.961530 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5de0bdb8-d745-435a-8bd3-46429c713f60 req-a4ea2dc0-75f7-4ec6-a3ce-7b8232d5dd49 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409138 May 20 20:39:27.224789 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['12bae04d-2991-4f75-a674-408e66033598'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:39:28.147813 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc5577d-00cf-4c55-abc8-c8c90a141fea req-63ed4a68-45eb-4c5a-a577-4f072b55cb91 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:28.149244 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9fc5577d-00cf-4c55-abc8-c8c90a141fea req-63ed4a68-45eb-4c5a-a577-4f072b55cb91 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 944 time: 0.0842857 May 20 20:39:28.194234 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9fc5577d-00cf-4c55-abc8-c8c90a141fea req-428b7bbd-26b8-4e77-a069-e1eb91f8511b tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387552 May 20 20:39:28.604651 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 12bae04d-2991-4f75-a674-408e66033598 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:39:28.674730 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 12bae04d-2991-4f75-a674-408e66033598 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:39:28.679442 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 12bae04d-2991-4f75-a674-408e66033598 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:39:28.679841 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:28.797942 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:28.825187 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '12bae04d-2991-4f75-a674-408e66033598'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:39:28.834467 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 12bae04d-2991-4f75-a674-408e66033598, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=12bae04d-2991-4f75-a674-408e66033598,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:39:28.838866 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:28.840872 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:39:28.905594 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=12bae04d-2991-4f75-a674-408e66033598,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:39:28.908669 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:39:28.997839 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '12bae04d-2991-4f75-a674-408e66033598', 'code': 200} May 20 20:39:29.254177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabe5a4e-0b5a-4a87-a48e-dd676fa99e0e req-aa13ee3a-1b39-4ffe-a72d-f9d8f87af9af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:29.255646 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cabe5a4e-0b5a-4a87-a48e-dd676fa99e0e req-aa13ee3a-1b39-4ffe-a72d-f9d8f87af9af service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 1098 time: 0.0732510 May 20 20:39:29.302937 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cabe5a4e-0b5a-4a87-a48e-dd676fa99e0e req-e57219fd-8c63-451b-92af-150e1098104d service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0351038 May 20 20:39:29.384118 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660d1d17-98f0-4bee-8cf4-948284f12649 req-4b8ffb1c-7ef9-4792-a871-c4a72b3ecc28 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:29.385558 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-660d1d17-98f0-4bee-8cf4-948284f12649 req-4b8ffb1c-7ef9-4792-a871-c4a72b3ecc28 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 945 time: 0.0787578 May 20 20:39:29.429479 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-660d1d17-98f0-4bee-8cf4-948284f12649 req-118cd3b1-5d2d-45ae-9504-6dfc7b02171b tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381167 May 20 20:39:30.716001 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0babfae-acd1-44e5-bb24-8e671f8d87f8 req-95bda95a-d908-4bd9-80c3-6b04a077a915 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:30.717514 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0babfae-acd1-44e5-bb24-8e671f8d87f8 req-95bda95a-d908-4bd9-80c3-6b04a077a915 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 945 time: 0.1776602 May 20 20:39:30.762058 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-b0babfae-acd1-44e5-bb24-8e671f8d87f8 req-d7f5c80d-6255-49cd-87b6-a75e8bbeb3eb tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381510 May 20 20:39:31.948256 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27412107-2265-47d7-babe-baab84eec678 req-54bf2dda-78cc-42bd-b347-8ee6beba9747 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:39:31.950459 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-27412107-2265-47d7-babe-baab84eec678 req-54bf2dda-78cc-42bd-b347-8ee6beba9747 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 945 time: 0.0834529 May 20 20:39:31.994052 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-27412107-2265-47d7-babe-baab84eec678 req-2655ee87-81dd-4eee-8e8c-a6ea1c3da902 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377893 May 20 20:39:34.785592 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-98001a04-8748-45c6-9209-ac9b26a43530 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:37.221112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:37.507051 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-59bab315-d9af-4d37-ab0a-4b69bbda9758 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:38.328339 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:39.934526 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:45.137671 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:39:45.808739 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:40:04.788879 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-f1574f58-0313-434d-8627-3329445441a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:07.227219 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:07.508133 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7758f2c6-510a-49df-92e2-2326c8c25a23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:08.333027 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:09.936845 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:15.134920 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:21.316094 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-bec75b1d-59f4-45de-8fda-43ff8db207b8 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0706913 May 20 20:40:21.467739 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-20e4372e-fb00-4796-b5d9-3a24fee9b036 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:21.469120 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-20e4372e-fb00-4796-b5d9-3a24fee9b036 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 1098 time: 0.0685279 May 20 20:40:21.622427 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-05945850-0fa0-44de-bbcc-4847f5f9fca2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:21.623870 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-05945850-0fa0-44de-bbcc-4847f5f9fca2 service neutron] 10.222.0.69 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 915 time: 0.1265128 May 20 20:40:21.695942 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-977d9e59-9610-4c02-8889-02e70241d5f1 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=12bae04d-2991-4f75-a674-408e66033598 HTTP/1.1" status: 200 len: 217 time: 0.0625966 May 20 20:40:21.761673 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-60d26074-2a36-42e6-a82e-9bc39f0ee5a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:21.762987 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-60d26074-2a36-42e6-a82e-9bc39f0ee5a4 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=7d63d754-5113-4c20-a4d0-ea2f48de8d9d HTTP/1.1" status: 200 len: 854 time: 0.0562069 May 20 20:40:21.815143 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-423af602-eee3-4664-832d-4cea6b158ae8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8510eab8-b63f-4b66-869e-57e3608edc12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0431874 May 20 20:40:21.945942 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-5b7c7dce-bd9a-476c-b3bb-b3da62ab56f2 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1220098 May 20 20:40:22.082121 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e26415cf-b1e9-4c2e-8d61-77a89a625098 req-b8ed7029-543a-4124-b034-94b0a907e002 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259024 May 20 20:40:22.808294 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:40:27.719196 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105f77e5-01b8-4e23-8608-582e2fb28799 req-7b96dcea-af75-48b5-aabc-ffd65d89eb6b tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:27.720580 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-105f77e5-01b8-4e23-8608-582e2fb28799 req-7b96dcea-af75-48b5-aabc-ffd65d89eb6b tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 945 time: 0.0895092 May 20 20:40:27.764925 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-105f77e5-01b8-4e23-8608-582e2fb28799 req-f9e9f9e8-9f2f-437b-a8f4-fbcdb00976d1 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380514 May 20 20:40:28.952604 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80be550-85b2-4af1-bc1a-537dedae1aab req-247f797e-7485-4ba6-bb2a-2cef00724dbc tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:28.954029 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c80be550-85b2-4af1-bc1a-537dedae1aab req-247f797e-7485-4ba6-bb2a-2cef00724dbc tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 945 time: 0.0803790 May 20 20:40:28.999061 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c80be550-85b2-4af1-bc1a-537dedae1aab req-01c31aa6-5b21-43b1-9464-b5d7f64634b3 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388429 May 20 20:40:30.174633 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-f9a0a163-6844-4419-9710-bf7c5bd31a06 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:30.176060 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-f9a0a163-6844-4419-9710-bf7c5bd31a06 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 945 time: 0.0890143 May 20 20:40:30.188394 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bdf0ce-b770-4313-be4c-cb727f161ec8 req-9abe4eef-38dc-466e-8548-b9645021452d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:30.189789 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-34bdf0ce-b770-4313-be4c-cb727f161ec8 req-9abe4eef-38dc-466e-8548-b9645021452d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 945 time: 0.0805440 May 20 20:40:30.235641 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-34bdf0ce-b770-4313-be4c-cb727f161ec8 req-ddbde200-b96b-49b3-a12a-c561b2640e86 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397995 May 20 20:40:30.314468 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Deleting port 12bae04d-2991-4f75-a674-408e66033598 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:40:30.314797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:30.443414 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] For port 12bae04d-2991-4f75-a674-408e66033598, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=12bae04d-2991-4f75-a674-408e66033598,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:40:30.443776 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:30.567665 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Calling delete_port for 12bae04d-2991-4f75-a674-408e66033598 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:40:30.676613 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:30.681929 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-bb41dac6-8c35-44a1-b354-2fa81ffc5fd1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:40:30.689064 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['12bae04d-2991-4f75-a674-408e66033598'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:40:30.729531 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Pushing event deleted for resources: {'Port': ['ID=12bae04d-2991-4f75-a674-408e66033598,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:40:30.851568 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.851961 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.852321 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.852666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.853022 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.853367 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.853715 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.854058 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.854402 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.854741 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.855083 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.855421 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:30.862285 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:40:30.896241 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] No DVR routers for this DVR port 12bae04d-2991-4f75-a674-408e66033598 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:40:30.899463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:30.901926 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'name': 'network-vif-deleted', 'tag': '12bae04d-2991-4f75-a674-408e66033598'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:40:30.918210 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4bbf119c-8d51-4b4f-9158-9afc43f0d059 req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "DELETE /v2.0/ports/12bae04d-2991-4f75-a674-408e66033598 HTTP/1.1" status: 204 len: 173 time: 0.7310114 May 20 20:40:30.952609 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90c51aa9-cbdb-4cac-a060-3691e42668ab', 'name': 'network-vif-deleted', 'tag': '12bae04d-2991-4f75-a674-408e66033598', 'status': 'completed', 'code': 200} May 20 20:40:31.401447 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-575758ef-31c4-460c-935c-03e30682fbde req-404d02b1-b9ac-405e-b354-46968c0ea509 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=90c51aa9-cbdb-4cac-a060-3691e42668ab HTTP/1.1" status: 200 len: 210 time: 0.0445385 May 20 20:40:34.791847 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-07588e42-edb9-4b53-a6ae-b96680b22f36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:35.807476 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 12bae04d-2991-4f75-a674-408e66033598 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:40:35.841637 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 12bae04d-2991-4f75-a674-408e66033598 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:40:35.841981 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 12bae04d-2991-4f75-a674-408e66033598 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:40:37.220586 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:37.510293 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3010ee15-8227-4220-a78d-df838e06d1ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:38.331583 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:39.940485 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:45.107039 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-4eef6fcb-8d87-42c4-a7b0-abcfd8409922 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:45.108406 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-4eef6fcb-8d87-42c4-a7b0-abcfd8409922 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 814 time: 0.2468984 May 20 20:40:45.124113 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-5b611497-b32d-4edc-9cf1-c155e9b5723e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/quotas/82385255062141d0a88d07f9748c7535 HTTP/1.1" status: 200 len: 375 time: 0.0101039 May 20 20:40:45.134215 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:45.172124 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-e0bc6b8a-a8a2-4eec-af76-107ed97bed74 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0426280 May 20 20:40:45.306631 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-f11c5ddd-37c9-49f3-afd7-2c0805f7e92a service neutron] 10.222.0.82 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262465 May 20 20:40:45.435691 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-dd14bd02-a22c-4a25-ad6f-52e9ee5e9ee2 service neutron] 10.222.0.82 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1232765 May 20 20:40:45.611611 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-cb00cc70-c9a9-4ef5-899c-ec4bab591370 req-1a3025b8-5b3c-4f04-9ed8-f5d02d7b0808 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Synchronizing usage tracker for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:40:45.627502 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-cb00cc70-c9a9-4ef5-899c-ec4bab591370 req-1a3025b8-5b3c-4f04-9ed8-f5d02d7b0808 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Unset dirty status for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:40:45.628830 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-cb00cc70-c9a9-4ef5-899c-ec4bab591370 req-1a3025b8-5b3c-4f04-9ed8-f5d02d7b0808 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 210 time: 0.0624256 May 20 20:40:46.785660 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dab4246a-1bd2-4542-bb23-e0843595688e req-f26e8bf6-1d7c-4920-b6e6-971687968f95 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 210 time: 0.0449095 May 20 20:40:46.816772 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-f17fd791-c4cd-47f9-b7e0-7bedd199a391 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:46.818176 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-f17fd791-c4cd-47f9-b7e0-7bedd199a391 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 814 time: 0.1510696 May 20 20:40:46.836677 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Request body: {'port': {'device_id': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12', 'admin_state_up': True, 'tenant_id': '82385255062141d0a88d07f9748c7535'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:40:46.972757 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:40:46.982569 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:40:46.991497 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Made reservation on behalf of 82385255062141d0a88d07f9748c7535 for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:40:46.994924 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:47.152703 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Allocated IP 172.20.0.11 (8510eab8-b63f-4b66-869e-57e3608edc12/7d63d754-5113-4c20-a4d0-ea2f48de8d9d/b20b996f-3ca7-43d0-af31-80f790dfae51) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:40:47.351350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:47.379844 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:47.385882 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9cbeda07-c659-4667-9606-9c4393ef21b1 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:40:47.451256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Network 8510eab8-b63f-4b66-869e-57e3608edc12 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:40:47.454285 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:40:47.458076 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:40:47.491159 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Pushing event updated for resources: {'Port': ['ID=b20b996f-3ca7-43d0-af31-80f790dfae51,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:40:47.497398 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:40:47.527680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:47.528305 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:47.552143 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-947e8088-d26f-440e-b490-b6658f011e4e tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7197299 May 20 20:40:47.569071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Request body: {'port': {'device_id': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:40:47.678927 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:48.023883 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e46399b-a3e9-4529-81d0-1adc3272a644 req-7fefb6e0-1c8f-459f-a50c-0ec6533111ff tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:48.024552 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4e46399b-a3e9-4529-81d0-1adc3272a644 req-7fefb6e0-1c8f-459f-a50c-0ec6533111ff tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Synchronizing usage tracker for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:40:48.084120 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b20b996f-3ca7-43d0-af31-80f790dfae51 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:40:48.090851 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-4e46399b-a3e9-4529-81d0-1adc3272a644 req-7fefb6e0-1c8f-459f-a50c-0ec6533111ff tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Unset dirty status for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:40:48.092009 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4e46399b-a3e9-4529-81d0-1adc3272a644 req-7fefb6e0-1c8f-459f-a50c-0ec6533111ff tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 932 time: 0.1974161 May 20 20:40:48.093821 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:48.130761 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Transition to ACTIVE for port object b20b996f-3ca7-43d0-af31-80f790dfae51 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:40:48.140928 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:48.150376 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-076cd2df-3522-4a4a-af26-5c0dd7516751 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:40:48.200015 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4e46399b-a3e9-4529-81d0-1adc3272a644 req-c05611ee-1273-4498-b673-9b2ad3f79aad tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015151 May 20 20:40:48.418023 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Pushing event updated for resources: {'Port': ['ID=b20b996f-3ca7-43d0-af31-80f790dfae51,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:40:48.421040 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:40:48.490527 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Attempting to bind port b20b996f-3ca7-43d0-af31-80f790dfae51 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:40:48.490852 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Attempting to bind port b20b996f-3ca7-43d0-af31-80f790dfae51 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:40:48.491169 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Attempting to bind port b20b996f-3ca7-43d0-af31-80f790dfae51 on network 8510eab8-b63f-4b66-869e-57e3608edc12 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:40:48.495842 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Port b20b996f-3ca7-43d0-af31-80f790dfae51 on network 8510eab8-b63f-4b66-869e-57e3608edc12 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:40:48.496154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Attempting to bind port b20b996f-3ca7-43d0-af31-80f790dfae51 on network 8510eab8-b63f-4b66-869e-57e3608edc12 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:40:48.501063 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 40, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:40:48.501387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Checking segment: {'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:40:48.501762 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Bound using segment: {'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:40:48.502175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Bound port: b20b996f-3ca7-43d0-af31-80f790dfae51, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '03635b69-792c-4399-af22-c4fd7e0936fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:40:48.502509 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:48.590625 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] For port b20b996f-3ca7-43d0-af31-80f790dfae51, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:40:48.593463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] For port b20b996f-3ca7-43d0-af31-80f790dfae51, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=b20b996f-3ca7-43d0-af31-80f790dfae51,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:40:48.599139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:48.603310 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-929544e1-27ac-4b8c-b670-934c25af1d35 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:40:48.658914 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:48.659512 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:48.660875 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] 10.222.0.69 "PUT /v2.0/ports/b20b996f-3ca7-43d0-af31-80f790dfae51 HTTP/1.1" status: 200 len: 1094 time: 1.0958431 May 20 20:40:48.661363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'tag': 'b20b996f-3ca7-43d0-af31-80f790dfae51'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:40:48.680856 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Pushing event updated for resources: {'Port': ['ID=b20b996f-3ca7-43d0-af31-80f790dfae51,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:40:48.683983 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:40:48.706778 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'tag': 'b20b996f-3ca7-43d0-af31-80f790dfae51', 'status': 'completed', 'code': 200} May 20 20:40:48.791067 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-60e1a226-cabd-49c9-979b-f892cbc7125d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:48.792575 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-60e1a226-cabd-49c9-979b-f892cbc7125d service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 1097 time: 0.0734236 May 20 20:40:48.865653 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-3197c1af-b27f-4915-a338-3abea6b1d3b6 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b20b996f-3ca7-43d0-af31-80f790dfae51 HTTP/1.1" status: 200 len: 217 time: 0.0594566 May 20 20:40:48.935425 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-40cb805a-dae7-4a0c-af76-24bdf4bac18b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:48.936772 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-40cb805a-dae7-4a0c-af76-24bdf4bac18b service neutron] 10.222.0.69 "GET /v2.0/subnets?id=7d63d754-5113-4c20-a4d0-ea2f48de8d9d HTTP/1.1" status: 200 len: 854 time: 0.0599582 May 20 20:40:48.990529 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-57348d48-3108-470f-94a7-88aca155133f service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8510eab8-b63f-4b66-869e-57e3608edc12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406363 May 20 20:40:49.130144 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-923ab8e6-2730-4c79-a06a-e3a9bdedc840 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1271608 May 20 20:40:49.272788 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-44cdcacd-93fd-4dcc-a8ae-01486c0db8ec req-845ddba9-d84c-48f2-88ef-7ad53b4930e7 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301205 May 20 20:40:49.452831 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81d1076-00e9-4f4f-82c5-978987a38890 req-48af058e-5bca-453e-9874-8099eec27af8 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:49.454262 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e81d1076-00e9-4f4f-82c5-978987a38890 req-48af058e-5bca-453e-9874-8099eec27af8 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 944 time: 0.1431706 May 20 20:40:49.456122 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-a137f423-c86a-4199-9ba1-ab9dff7cb808 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:49.457479 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-a137f423-c86a-4199-9ba1-ab9dff7cb808 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 1097 time: 0.1131985 May 20 20:40:49.580637 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e81d1076-00e9-4f4f-82c5-978987a38890 req-07b534bd-806b-474a-9a6b-4e543a459a7d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202426 May 20 20:40:49.620635 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-f0d83d55-e9db-4c02-a2b4-031effd20b4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:49.622099 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-f0d83d55-e9db-4c02-a2b4-031effd20b4e service neutron] 10.222.0.69 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 915 time: 0.1490290 May 20 20:40:49.700748 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-74299ef9-0626-41ab-b6af-0be40fdf8a9b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b20b996f-3ca7-43d0-af31-80f790dfae51 HTTP/1.1" status: 200 len: 217 time: 0.0656340 May 20 20:40:49.770002 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-8a10b743-2128-4b4c-ae66-2e42ed286a7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:49.771315 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-8a10b743-2128-4b4c-ae66-2e42ed286a7e service neutron] 10.222.0.69 "GET /v2.0/subnets?id=7d63d754-5113-4c20-a4d0-ea2f48de8d9d HTTP/1.1" status: 200 len: 854 time: 0.0583551 May 20 20:40:49.827633 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-56fa9757-3274-48e3-9469-646b00f94edd service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8510eab8-b63f-4b66-869e-57e3608edc12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0453739 May 20 20:40:49.962961 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-ab6fb09b-1b23-4a58-9b23-bf9628a685cf service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1224275 May 20 20:40:50.102133 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1b41e768-4f7a-4918-8adc-2b18285d5bbe req-1538c47c-cebf-4459-88a8-61375de1838b service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248767 May 20 20:40:50.773653 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcbf776-d40b-47e9-bbaf-b5dfad47ee1f req-42f21349-e399-4220-ab4a-f4025c9c72ea tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:50.775244 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-abcbf776-d40b-47e9-bbaf-b5dfad47ee1f req-42f21349-e399-4220-ab4a-f4025c9c72ea tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 944 time: 0.0868952 May 20 20:40:50.820179 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-abcbf776-d40b-47e9-bbaf-b5dfad47ee1f req-3453a4aa-77a0-480a-a891-1bf06dd5b15f tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391738 May 20 20:40:52.006436 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c5b8be-42fc-498a-9c8a-71be428a2b25 req-d68d0711-2316-4340-b766-36c51d6f5e25 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:52.008491 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6c5b8be-42fc-498a-9c8a-71be428a2b25 req-d68d0711-2316-4340-b766-36c51d6f5e25 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 944 time: 0.0795326 May 20 20:40:52.055394 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d6c5b8be-42fc-498a-9c8a-71be428a2b25 req-2eb6d0c4-d9d3-48e7-8956-5b77ab83a255 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406687 May 20 20:40:53.114990 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device b20b996f-3ca7-43d0-af31-80f790dfae51 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:40:53.245369 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008cd4d6-948f-45f1-9bae-bb12eb322358 req-21d0e0c4-28c2-4fd4-9047-10d2781dbfc9 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:53.246849 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-008cd4d6-948f-45f1-9bae-bb12eb322358 req-21d0e0c4-28c2-4fd4-9047-10d2781dbfc9 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 944 time: 0.0812759 May 20 20:40:53.249924 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port b20b996f-3ca7-43d0-af31-80f790dfae51, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=b20b996f-3ca7-43d0-af31-80f790dfae51,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:40:53.263949 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': 'b20b996f-3ca7-43d0-af31-80f790dfae51', 'network_id': '8510eab8-b63f-4b66-869e-57e3608edc12', 'port_id': 'b20b996f-3ca7-43d0-af31-80f790dfae51', 'mac_address': 'fa:16:3e:21:9f:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 805, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7d63d754-5113-4c20-a4d0-ea2f48de8d9d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:40:53.295933 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-008cd4d6-948f-45f1-9bae-bb12eb322358 req-8d9f7bfa-97a4-47e6-aca3-9724634faf44 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431709 May 20 20:40:53.318718 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:53.335632 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b20b996f-3ca7-43d0-af31-80f790dfae51 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:40:53.351394 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port b20b996f-3ca7-43d0-af31-80f790dfae51, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=b20b996f-3ca7-43d0-af31-80f790dfae51,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:40:53.355582 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:53.357348 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:40:53.425911 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=b20b996f-3ca7-43d0-af31-80f790dfae51,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:40:53.433934 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.434277 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.434608 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.434935 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.435257 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.435579 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.435944 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.436260 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.436576 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.436890 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.437202 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.437515 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:40:53.441321 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:40:53.712576 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['b20b996f-3ca7-43d0-af31-80f790dfae51'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:40:54.579430 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da14b45-ee18-4e9d-a507-ba206950aed2 req-e8a6c36d-39c3-42c3-be41-fce506db28a1 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:54.580817 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6da14b45-ee18-4e9d-a507-ba206950aed2 req-e8a6c36d-39c3-42c3-be41-fce506db28a1 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 945 time: 0.1774364 May 20 20:40:54.625530 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6da14b45-ee18-4e9d-a507-ba206950aed2 req-5e91d963-d1cd-4741-b1c2-e66422b98d30 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378137 May 20 20:40:55.129991 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device b20b996f-3ca7-43d0-af31-80f790dfae51 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:40:55.230870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port b20b996f-3ca7-43d0-af31-80f790dfae51 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:40:55.235502 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port b20b996f-3ca7-43d0-af31-80f790dfae51 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:40:55.235907 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:55.353473 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:55.380670 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b20b996f-3ca7-43d0-af31-80f790dfae51'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:40:55.391285 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port b20b996f-3ca7-43d0-af31-80f790dfae51, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=b20b996f-3ca7-43d0-af31-80f790dfae51,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:40:55.395528 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:40:55.397435 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:40:55.427932 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b20b996f-3ca7-43d0-af31-80f790dfae51', 'code': 200} May 20 20:40:55.469099 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=b20b996f-3ca7-43d0-af31-80f790dfae51,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:40:55.471918 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:40:55.692350 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe8ee87-52db-4b67-9ac6-1edcbcc5fa58 req-9f8dde6f-c886-470f-9acc-abf1cf9e00b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:55.693803 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4fe8ee87-52db-4b67-9ac6-1edcbcc5fa58 req-9f8dde6f-c886-470f-9acc-abf1cf9e00b1 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 1099 time: 0.0695276 May 20 20:40:55.741358 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4fe8ee87-52db-4b67-9ac6-1edcbcc5fa58 req-220b5c81-9747-44c7-a76b-9cd7746d8fa7 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361850 May 20 20:40:55.821501 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac975ba-02fe-439a-b7cd-7a999aab60fc req-59bd67cb-dabc-456b-b914-4629fdea91eb tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:55.822953 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2ac975ba-02fe-439a-b7cd-7a999aab60fc req-59bd67cb-dabc-456b-b914-4629fdea91eb tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 946 time: 0.0836501 May 20 20:40:55.870100 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2ac975ba-02fe-439a-b7cd-7a999aab60fc req-787fe765-ff0b-40e7-8390-be55533b2b32 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409648 May 20 20:40:57.059565 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f551b13-b8a0-4ec6-b70e-8def1fbb88f3 req-d1091b57-1220-4e11-8089-43c22bc7584a tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:57.061089 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1f551b13-b8a0-4ec6-b70e-8def1fbb88f3 req-d1091b57-1220-4e11-8089-43c22bc7584a tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 946 time: 0.0832832 May 20 20:40:57.106342 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1f551b13-b8a0-4ec6-b70e-8def1fbb88f3 req-b4003c3d-67ba-4b4d-b8cb-00e22e00aa5d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393989 May 20 20:40:58.299309 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5fb671c-7ff4-476b-8642-992d4df6483e req-a8b8e0df-2070-4154-a7a8-644eb33f0121 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:40:58.300641 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f5fb671c-7ff4-476b-8642-992d4df6483e req-a8b8e0df-2070-4154-a7a8-644eb33f0121 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 946 time: 0.0822153 May 20 20:40:58.344470 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f5fb671c-7ff4-476b-8642-992d4df6483e req-920c48c3-ec0a-430a-92c5-d1bc5d5bf680 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379717 May 20 20:40:59.807797 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:41:04.794463 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-21c20975-60d2-4d78-b8da-e6c55087b4c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:07.223682 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:07.512432 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-bfecde0d-f403-4a48-8c6e-871dcc5c67bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:08.336613 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:09.942679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:15.154669 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:17.308739 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-fcba36ed-df43-4ec1-9dc6-746f665bff95 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0763652 May 20 20:41:17.469179 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-9dff2197-228e-4228-beac-96d06f48303e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:17.470548 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-9dff2197-228e-4228-beac-96d06f48303e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=82385255062141d0a88d07f9748c7535&device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 1099 time: 0.0817788 May 20 20:41:17.628944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-e0760935-876e-422d-8ffc-e3d22b2bd1f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:17.630406 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-e0760935-876e-422d-8ffc-e3d22b2bd1f1 service neutron] 10.222.0.69 "GET /v2.0/networks?id=8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 200 len: 915 time: 0.1319222 May 20 20:41:17.703011 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-d6e06f6f-6938-42e6-8144-804067c2e354 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b20b996f-3ca7-43d0-af31-80f790dfae51 HTTP/1.1" status: 200 len: 217 time: 0.0600581 May 20 20:41:17.774322 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-22e5566b-4187-40e8-bbe2-7f5b03b55c6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:17.775636 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-22e5566b-4187-40e8-bbe2-7f5b03b55c6c service neutron] 10.222.0.69 "GET /v2.0/subnets?id=7d63d754-5113-4c20-a4d0-ea2f48de8d9d HTTP/1.1" status: 200 len: 854 time: 0.0604613 May 20 20:41:17.831145 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-367cc660-04d9-4b71-a630-782f88a67e3e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8510eab8-b63f-4b66-869e-57e3608edc12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0425584 May 20 20:41:17.969228 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-5510890c-59ee-4220-862e-d6eeba05777c service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1260667 May 20 20:41:18.107564 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-24c8255b-ff6b-49db-b26d-19b9f6b55cf5 req-749dbda3-7b5e-4fff-be42-720d02810306 service neutron] 10.222.0.69 "GET /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260300 May 20 20:41:22.788833 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2174db89-f630-4dcb-aee8-bbab8c5fb3c4 req-66ed5c17-0470-4d1e-9694-5e0c026effda tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:22.791211 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2174db89-f630-4dcb-aee8-bbab8c5fb3c4 req-66ed5c17-0470-4d1e-9694-5e0c026effda tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 946 time: 0.0816894 May 20 20:41:22.840423 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2174db89-f630-4dcb-aee8-bbab8c5fb3c4 req-a57a8406-42d7-4710-978c-ec87082b759d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432191 May 20 20:41:24.034043 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c012541f-d4bf-43ed-9c82-b794edd752c7 req-cc7feb78-3f02-4b3c-8e33-8e87ccc56107 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:24.035479 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c012541f-d4bf-43ed-9c82-b794edd752c7 req-cc7feb78-3f02-4b3c-8e33-8e87ccc56107 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 946 time: 0.0872545 May 20 20:41:24.082803 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-c012541f-d4bf-43ed-9c82-b794edd752c7 req-fc7b9c6d-818d-440e-84b8-69a61334d85f tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410228 May 20 20:41:25.304499 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-77fa1443-af27-4a5a-a83e-cc68c083fb2b tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:25.306700 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-77fa1443-af27-4a5a-a83e-cc68c083fb2b tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 946 time: 0.1367195 May 20 20:41:25.318167 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49257952-f86e-487d-b9ef-a9a293ad768a req-91dfaa34-c142-42d5-a3a7-6cf4c6b94bd6 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:25.319519 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-49257952-f86e-487d-b9ef-a9a293ad768a req-91dfaa34-c142-42d5-a3a7-6cf4c6b94bd6 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 946 time: 0.1164064 May 20 20:41:25.440535 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-49257952-f86e-487d-b9ef-a9a293ad768a req-0d6e6096-77c5-4a61-97b9-d1771644b6f6 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914352 May 20 20:41:25.484984 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Deleting port b20b996f-3ca7-43d0-af31-80f790dfae51 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:41:25.485324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:25.708105 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] For port b20b996f-3ca7-43d0-af31-80f790dfae51, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=b20b996f-3ca7-43d0-af31-80f790dfae51,segment=NetworkSegment(03635b69-792c-4399-af22-c4fd7e0936fd),segment_id=03635b69-792c-4399-af22-c4fd7e0936fd)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:41:25.708415 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:25.827195 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Calling delete_port for b20b996f-3ca7-43d0-af31-80f790dfae51 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:41:25.939856 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:25.945679 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:25.959496 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['b20b996f-3ca7-43d0-af31-80f790dfae51'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:41:25.993370 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Pushing event deleted for resources: {'Port': ['ID=b20b996f-3ca7-43d0-af31-80f790dfae51,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:25.996325 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:26.069003 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] No DVR routers for this DVR port b20b996f-3ca7-43d0-af31-80f790dfae51 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:41:26.072143 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:26.074665 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'name': 'network-vif-deleted', 'tag': 'b20b996f-3ca7-43d0-af31-80f790dfae51'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:41:26.090323 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2084b9e5-3734-44ed-b93a-eab28b44b472 req-eee091c2-d5b1-4aad-95a1-c11de63f688d tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.69 "DELETE /v2.0/ports/b20b996f-3ca7-43d0-af31-80f790dfae51 HTTP/1.1" status: 204 len: 173 time: 0.7697709 May 20 20:41:26.122238 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '074c62d7-8214-4ab3-9b58-ee6ca81a8947', 'name': 'network-vif-deleted', 'tag': 'b20b996f-3ca7-43d0-af31-80f790dfae51', 'status': 'completed', 'code': 200} May 20 20:41:26.598624 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-90f5b550-51ea-48e0-96b6-b71139cea2d0 req-d5e00da6-0417-4379-83a4-b200700b13f9 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Synchronizing usage tracker for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:41:26.614366 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-90f5b550-51ea-48e0-96b6-b71139cea2d0 req-d5e00da6-0417-4379-83a4-b200700b13f9 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] Unset dirty status for tenant:82385255062141d0a88d07f9748c7535 on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:41:26.615554 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-90f5b550-51ea-48e0-96b6-b71139cea2d0 req-d5e00da6-0417-4379-83a4-b200700b13f9 tempest-VolumesSnapshotTestJSON-1939865835 tempest-VolumesSnapshotTestJSON-1939865835-project] 10.222.0.82 "GET /v2.0/ports?device_id=074c62d7-8214-4ab3-9b58-ee6ca81a8947 HTTP/1.1" status: 200 len: 210 time: 0.0581214 May 20 20:41:29.367046 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device b20b996f-3ca7-43d0-af31-80f790dfae51 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:41:29.405787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: b20b996f-3ca7-43d0-af31-80f790dfae51 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:41:29.405787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device b20b996f-3ca7-43d0-af31-80f790dfae51 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:41:34.796906 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e391c8c0-f770-44ac-a741-03b5118a7341 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:36.806365 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:41:37.228033 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:37.515376 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ab2e2606-0ba5-41c2-b463-fad5090ab7dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:38.339542 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:39.946471 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:45.158999 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.228163 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47128) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:41:55.286963 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Deleting subnet 7d63d754-5113-4c20-a4d0-ea2f48de8d9d {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:41:55.289886 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.342305 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.396659 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.641386 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.645124 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:55.680356 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7d63d754-5113-4c20-a4d0-ea2f48de8d9d,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:55.682797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.692929 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/7d63d754-5113-4c20-a4d0-ea2f48de8d9d HTTP/1.1" status: 204 len: 168 time: 0.4637609 May 20 20:41:55.694553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.694737 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.695111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.695476 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.695596 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47132) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:41:55.696043 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.696237 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.696574 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.696929 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.697285 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.697640 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.697993 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.698342 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:55.701659 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-dc86e464-aa75-45ad-92af-f1c11822b651 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:55.804253 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.929192 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.942121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8510eab8-b63f-4b66-869e-57e3608edc12']}} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:41:55.954412 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '03635b69-792c-4399-af22-c4fd7e0936fd') {'for_net_delete': True} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:41:55.954704 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.services.segments.db [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '03635b69-792c-4399-af22-c4fd7e0936fd') {} {{(pid=91645) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:41:55.967038 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3093730'] for segment, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.983149 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:55.989025 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Releasing vlan 805 on physical network physnet1 to pool {{(pid=91645) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:41:55.989399 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3178480'] for segment, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: Traceback (most recent call last): May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: timer() May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: cb(*args, **kw) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: return func(*args, **kwargs) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: self._notify() May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: self.callback(batched_events) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: event.method(event) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: return f(self, *a, **k) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._get(url).json() May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: return self.request(url, 'GET', **kwargs) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:41:56.002688 dv-cinder-784623-13-iscsi neutron-server[91645]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:41:56.079788 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:56.083605 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:56.096822 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:56.108198 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Pushing event deleted for resources: {'Network': ['ID=8510eab8-b63f-4b66-869e-57e3608edc12,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:56.116990 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] 10.222.0.82 "DELETE /v2.0/networks/8510eab8-b63f-4b66-869e-57e3608edc12 HTTP/1.1" status: 204 len: 168 time: 0.4204485 May 20 20:41:56.118783 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.119129 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.119489 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.119874 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.120226 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.121063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.121063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.121389 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.121737 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.122065 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.122410 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.122750 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:56.126622 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f29dfc46-364d-4053-bc51-4abe2a169d9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:56.255586 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47138) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:41:56.306481 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3f4ffd40-30aa-42a7-8add-7b3515e2579b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=82385255062141d0a88d07f9748c7535&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0496531 May 20 20:41:56.309567 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47142) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:41:56.367074 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cdb84171-949f-4843-a31c-49c856036f97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:56.393660 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cdb84171-949f-4843-a31c-49c856036f97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:56.452644 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cdb84171-949f-4843-a31c-49c856036f97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:56.456325 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fda11700-c8ef-4b4d-b178-c2c7453fd4c4 tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:56.469706 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb84171-949f-4843-a31c-49c856036f97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0a9516e-d6e5-442b-80fd-eb2b1efd0f06,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:56.472831 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-cdb84171-949f-4843-a31c-49c856036f97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:56.483282 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-cdb84171-949f-4843-a31c-49c856036f97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:56.484437 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-cdb84171-949f-4843-a31c-49c856036f97 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b0a9516e-d6e5-442b-80fd-eb2b1efd0f06 HTTP/1.1" status: 204 len: 168 time: 0.1739395 May 20 20:41:57.241233 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47166) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:41:57.375281 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1489691636-network', 'tenant_id': '0fc67707e21b4394989903515082b61d'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:41:57.380046 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:41:57.383827 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Usage tracker for resource:network and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:41:57.386720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:41:57.393087 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:41:57.402991 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Made reservation on behalf of 0fc67707e21b4394989903515082b61d for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:41:57.405459 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.417178 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.431579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:41:57.435431 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:41:57.438177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:41:57.443756 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:41:57.526900 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.532894 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.535826 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-459d6f61-122b-4b22-a47b-95c0234be4a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:57.568030 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] vlan segment allocate from pool success with {'vlan_id': 830, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:41:57.578099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c5ae52b-9b34-4400-b7b8-0caac2cd1253,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:57.582062 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:57.582962 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.583292 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Added segment 32ff4298-05a9-47bb-9b1a-5c7862ae42f7 of type vlan for network 9997745d-f55f-4dcf-a08c-5d192080ee30 May 20 20:41:57.609935 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.639282 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.640858 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:57.641441 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:57.646132 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e8dee51e-cf2e-4039-9217-b3973baa3657 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:57.740075 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4977102 May 20 20:41:57.742919 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47172) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:41:57.749143 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Request body: {'subnet': {'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1489691636-subnet', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:41:57.749326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Pushing event updated for resources: {'Network': ['ID=9997745d-f55f-4dcf-a08c-5d192080ee30,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:57.751847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-463bce3b-8155-43cc-81dd-0925faf5fc0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:57.755240 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:41:57.758860 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:41:57.760040 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Usage tracker for resource:subnet and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:41:57.764030 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:41:57.769869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:41:57.781399 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Made reservation on behalf of 0fc67707e21b4394989903515082b61d for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:41:57.783621 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4127911'] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.278520 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3178265', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4127925'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.283141 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-6ceff933-b830-49f8-8e28-192a5867fd7c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:58.357222 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5f15ab56-6f84-44c6-ba41-332f6baa9746,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:58.361160 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:58.365252 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Checking segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:41:58.365608 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Network hostable DHCP agents. Network: 9997745d-f55f-4dcf-a08c-5d192080ee30, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:41:58.383582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:41:58.392942 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, 9997745d-f55f-4dcf-a08c-5d192080ee30) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:41:58.401133 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:41:58.401713 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.402636 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f251240-2a98-41ed-ad28-8e9b22084651 None None] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:41:58.421737 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-bf1b92e3-4ec0-48d7-b497-10d3b7f63141 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6776729 May 20 20:41:58.424466 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47176) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:41:58.429646 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:41:58.435337 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:41:58.439229 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Usage tracker for resource:router and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:41:58.442093 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:41:58.447896 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:41:58.458550 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.459502 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.475860 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.619338 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-9997745d-f55f-4dcf-a08c-5d192080ee30', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:41:58.619907 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.754351 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.775111 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Allocated IP 172.20.0.2 (9997745d-f55f-4dcf-a08c-5d192080ee30/5f15ab56-6f84-44c6-ba41-332f6baa9746/678dace7-e21b-4e15-95b9-796babc972bb) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:41:58.976733 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:58.986286 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Transition to ACTIVE for port object 678dace7-e21b-4e15-95b9-796babc972bb will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:41:59.004680 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Transition to ACTIVE for port object 678dace7-e21b-4e15-95b9-796babc972bb will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:41:59.010688 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.014928 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:59.064809 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.082066 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:41:59.084875 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:41:59.088619 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:41:59.094431 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Pushing event updated for resources: {'Port': ['ID=678dace7-e21b-4e15-95b9-796babc972bb,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:59.094616 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.131162 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.131497 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.131855 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.132184 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.132506 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.132827 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.133148 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.133466 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.133789 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.134104 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.134434 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.134731 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:41:59.142259 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:59.194038 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Attempting to bind port 678dace7-e21b-4e15-95b9-796babc972bb on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:41:59.194407 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Attempting to bind port 678dace7-e21b-4e15-95b9-796babc972bb by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:41:59.194768 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Attempting to bind port 678dace7-e21b-4e15-95b9-796babc972bb on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:41:59.200529 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 41, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:41:59.200906 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Checking segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:41:59.201311 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.201704 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Bound using segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:41:59.202170 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Bound port: 678dace7-e21b-4e15-95b9-796babc972bb, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:41:59.206273 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.236478 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Allocated IP 172.27.3.200 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/733a6917-9e40-4a57-8e84-63f60a792028) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:41:59.294241 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] For port 678dace7-e21b-4e15-95b9-796babc972bb, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:41:59.297562 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] For port 678dace7-e21b-4e15-95b9-796babc972bb, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=678dace7-e21b-4e15-95b9-796babc972bb,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:41:59.301384 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.305787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:59.383686 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.401268 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Pushing event updated for resources: {'Port': ['ID=678dace7-e21b-4e15-95b9-796babc972bb,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:59.406176 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-dc3a292a-63f8-43db-a24e-dfed90756f3c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:41:59.417053 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:41:59.421546 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-bcc9dcf7-1181-462a-bb7e-35a127b6391a tempest-DeleteServersTestJSON-1282059006 tempest-DeleteServersTestJSON-1282059006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:41:59.484870 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:41:59.487867 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:41:59.491591 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:41:59.528087 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Pushing event updated for resources: {'Port': ['ID=733a6917-9e40-4a57-8e84-63f60a792028,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:41:59.532642 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:00.025072 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:00.140372 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 678dace7-e21b-4e15-95b9-796babc972bb up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:00.220382 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 678dace7-e21b-4e15-95b9-796babc972bb completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:00.321096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-218e3acf-9b22-471a-9c7a-b79b8692b50d None None] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:42:00.376662 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:00.436823 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] Provisioning for port 678dace7-e21b-4e15-95b9-796babc972bb completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:00.453078 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] Provisioning complete for port 678dace7-e21b-4e15-95b9-796babc972bb triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:00.453462 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:00.580978 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91645) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:42:00.679394 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:00.720249 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] For port 678dace7-e21b-4e15-95b9-796babc972bb, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=678dace7-e21b-4e15-95b9-796babc972bb,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:00.724873 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:00.726770 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-9f918ecd-3a65-43f3-be31-22b303d64952 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:00.766321 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:42:00.778066 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:42:00.790827 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:00.792519 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.3668551 May 20 20:42:00.795463 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47180) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:00.800878 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:00.801503 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:41:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:00.869501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] Pushing event updated for resources: {'Port': ['ID=678dace7-e21b-4e15-95b9-796babc972bb,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:00.874623 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-b3adad47-62e8-496b-93fd-a5f2ae9ee9c9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:00.990047 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:01.182374 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-9d572c72-4a7c-42b3-916d-519d13328a46 None None] Provisioning complete for port 678dace7-e21b-4e15-95b9-796babc972bb triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:01.183102 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9d572c72-4a7c-42b3-916d-519d13328a46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.388700 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:41:59Z', 'revision_number': 3, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:41:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:01.392669 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:42:01.393017 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Updating router 54a652d4-d116-469b-8ba9-8eff8bf74de6 port 733a6917-9e40-4a57-8e84-63f60a792028 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:42:01.447634 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.565837 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.771983 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Allocated IP 172.20.0.1 (9997745d-f55f-4dcf-a08c-5d192080ee30/5f15ab56-6f84-44c6-ba41-332f6baa9746/8aa5b8c0-1a39-4704-97c1-04489bd936cd) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:42:01.774584 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.788029 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Transition to ACTIVE for port object 733a6917-9e40-4a57-8e84-63f60a792028 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:01.794886 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.798538 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:01.873999 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Attempting to bind port 733a6917-9e40-4a57-8e84-63f60a792028 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:42:01.874374 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Attempting to bind port 733a6917-9e40-4a57-8e84-63f60a792028 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:42:01.874741 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Attempting to bind port 733a6917-9e40-4a57-8e84-63f60a792028 on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:42:01.876862 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faefcbd7-e129-4ed7-a35d-ab2900bf8052 None None] Pushing event updated for resources: {'Port': ['ID=733a6917-9e40-4a57-8e84-63f60a792028,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:01.880564 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-faefcbd7-e129-4ed7-a35d-ab2900bf8052 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:01.883025 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 41, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:42:01.883401 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:42:01.883834 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.884724 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:42:01.884724 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Bound port: 733a6917-9e40-4a57-8e84-63f60a792028, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:42:01.885064 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.924378 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.942311 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Transition to ACTIVE for port object 8aa5b8c0-1a39-4704-97c1-04489bd936cd will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:01.967010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:01.971526 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:02.001233 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] For port 733a6917-9e40-4a57-8e84-63f60a792028, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:42:02.004423 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] For port 733a6917-9e40-4a57-8e84-63f60a792028, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=733a6917-9e40-4a57-8e84-63f60a792028,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:42:02.008455 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.012544 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:02.032664 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:02.035506 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:02.039074 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:42:02.083423 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Pushing event updated for resources: {'Port': ['ID=8aa5b8c0-1a39-4704-97c1-04489bd936cd,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:02.094771 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:02.095406 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:41:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:02.102868 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:02.117592 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.156716 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 678dace7-e21b-4e15-95b9-796babc972bb up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:02.234451 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faefcbd7-e129-4ed7-a35d-ab2900bf8052 None None] Pushing event updated for resources: {'Port': ['ID=733a6917-9e40-4a57-8e84-63f60a792028,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:02.244997 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-faefcbd7-e129-4ed7-a35d-ab2900bf8052 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:02.349445 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-ddd89408-4876-43c7-b96d-be3e605f6744 None None] Provisioning for port 8aa5b8c0-1a39-4704-97c1-04489bd936cd completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:02.366070 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:02.379619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.408291 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-ddd89408-4876-43c7-b96d-be3e605f6744 None None] Provisioning complete for port 8aa5b8c0-1a39-4704-97c1-04489bd936cd triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:02.408674 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ddd89408-4876-43c7-b96d-be3e605f6744 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.519911 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 678dace7-e21b-4e15-95b9-796babc972bb triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:02.520287 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.600814 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-ddd89408-4876-43c7-b96d-be3e605f6744 None None] Port 8aa5b8c0-1a39-4704-97c1-04489bd936cd cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:42:02.603131 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.607993 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.634635 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:02.716666 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:02.720026 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Pushing event updated for resources: {'Port': ['ID=8aa5b8c0-1a39-4704-97c1-04489bd936cd,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:02.723256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:02.816040 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:41:59Z', 'revision_number': 3, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:02.820248 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2f4bfff-47cc-456a-98d7-5510912ad27b None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:41:59Z', 'revision_number': 3, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:42:02.971323 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:02.972372 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:03.184684 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:42:03.228305 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-ef6e5442-e6dc-4222-8b71-51e598498ac6 None None] Provisioning complete for port 8aa5b8c0-1a39-4704-97c1-04489bd936cd triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:03.228690 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ef6e5442-e6dc-4222-8b71-51e598498ac6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:03.285406 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-ef6e5442-e6dc-4222-8b71-51e598498ac6 None None] Port 8aa5b8c0-1a39-4704-97c1-04489bd936cd cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:42:03.374776 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:42:03.383708 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] 10.222.0.82 "PUT /v2.0/routers/54a652d4-d116-469b-8ba9-8eff8bf74de6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5859809 May 20 20:42:03.890164 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47200) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:03.896009 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-547805053-network', 'tenant_id': 'e033980e044a4e7bbdb78184080166be'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:03.900689 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:03.904728 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Usage tracker for resource:network and tenant:e033980e044a4e7bbdb78184080166be is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:03.907506 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:03.913393 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:03.925295 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Made reservation on behalf of e033980e044a4e7bbdb78184080166be for: {'network': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:42:03.927574 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-16469392'] for network, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:03.943276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:03.958625 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:03.962639 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Usage tracker for resource:security_group_rule and tenant:e033980e044a4e7bbdb78184080166be is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:03.966925 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:03.973041 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:04.067901 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.073153 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.076680 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-67fa6928-1364-467d-b4ef-6bca2c5a2d3a tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:04.110372 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] vlan segment allocate from pool success with {'vlan_id': 809, 'physical_network': 'physnet1'} {{(pid=91646) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 20 20:42:04.120830 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb0e568b-acc3-4552-ba07-2903862cdd1d,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:04.124687 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:04.129448 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.129786 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.segments_db [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Added segment 807dfd29-e595-4465-a0fd-ac78b3a2c520 of type vlan for network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c May 20 20:42:04.143268 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 733a6917-9e40-4a57-8e84-63f60a792028 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:04.158988 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8742245638849'] for network, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.192905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570'] for network, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.195424 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:04.196208 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.202296 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:04.217247 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 733a6917-9e40-4a57-8e84-63f60a792028 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:04.223173 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 733a6917-9e40-4a57-8e84-63f60a792028 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:04.223744 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.300851 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.4095747 May 20 20:42:04.303660 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47204) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:04.309998 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Pushing event updated for resources: {'Network': ['ID=ebd2ede6-2eb5-48d9-a114-c29ca4cd817c,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:04.310164 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Request body: {'subnet': {'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-547805053-subnet', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'ip_version': 4}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:04.313020 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3b97c936-dd22-4afe-b662-4dc55b30dce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:04.314824 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:04.319489 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Usage tracker for resource:subnet and tenant:e033980e044a4e7bbdb78184080166be is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:04.321533 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c details requested by agent ovs-agent-dv-cinder-784623-13-iscsi with host dv-cinder-784623-13-iscsi {{(pid=91647) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 20 20:42:04.324933 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:04.330850 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:04.343350 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Made reservation on behalf of e033980e044a4e7bbdb78184080166be for: {'subnet': 1} {{(pid=91645) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:42:04.345728 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4127911'] for subnet, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.391492 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:42:04.401193 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:04.402065 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:41:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:04.434522 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.457562 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 733a6917-9e40-4a57-8e84-63f60a792028, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=733a6917-9e40-4a57-8e84-63f60a792028,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:04.462649 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.465349 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-faefcbd7-e129-4ed7-a35d-ab2900bf8052 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:04.537766 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=733a6917-9e40-4a57-8e84-63f60a792028,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:04.540890 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:04.626768 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:04.800395 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8cde9af6-84c9-4387-abfa-4ffd9d744bb9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.865291 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3178265', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4127925'] for subnet, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:04.869884 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-92eac7c6-5942-4add-b642-5bdec49c2e03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:04.945941 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2bb96e03-282c-4ec2-a1ec-d848893f9fca,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:04.948785 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:04.953728 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 2, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:04.953932 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Checking segment: {'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91645) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:42:04.954058 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Network hostable DHCP agents. Network: ebd2ede6-2eb5-48d9-a114-c29ca4cd817c, hostable agents: ['c6069225-a65d-4d8c-b6cd-ac65371f8ffa'], hosted agents: [] {{(pid=91645) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 20 20:42:04.957641 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:42:04.957995 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Updating router 54a652d4-d116-469b-8ba9-8eff8bf74de6 port 8aa5b8c0-1a39-4704-97c1-04489bd936cd binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:42:04.970923 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c is scheduled to be hosted by DHCP agent c6069225-a65d-4d8c-b6cd-ac65371f8ffa with binding_index 1 {{(pid=91645) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 20 20:42:04.979810 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784623-13-iscsi, ebd2ede6-2eb5-48d9-a114-c29ca4cd817c) {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:04.989426 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fe32c06-396a-45b0-91d0-83aadc344d99 None None] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:42:04.989734 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:04.990314 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.013710 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-53d89589-6a9a-4c91-9f04-636849732a01 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7086966 May 20 20:42:05.015824 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47208) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:05.021182 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:05.022237 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.027256 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:05.030582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Usage tracker for resource:router and tenant:e033980e044a4e7bbdb78184080166be is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:05.033715 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:05.040196 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:05.054429 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-735135', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2393'] for router, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.055581 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-734345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-662494', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-577850', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2402'] for router, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.076371 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.267731 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp28831fcf-1d07-562e-801b-2ec553b7abbd-ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'fixed_ips': [{'subnet_id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca'}]}} from dv-cinder-784623-13-iscsi. {{(pid=91647) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 20 20:42:05.268630 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.359238 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-662508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-735113', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2428'] for router, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.385751 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.399888 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Transition to ACTIVE for port object 8aa5b8c0-1a39-4704-97c1-04489bd936cd will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:05.407295 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.411174 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-e0a14e06-f06f-4e3c-b751-d7ca6a787ae6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:05.431162 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.db_base_plugin_common [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Allocated IP 172.20.0.2 (ebd2ede6-2eb5-48d9-a114-c29ca4cd817c/2bb96e03-282c-4ec2-a1ec-d848893f9fca/e9162113-5422-4f6b-8d20-f165d3d4f0cc) {{(pid=91647) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:42:05.608863 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Pushing event updated for resources: {'Port': ['ID=8aa5b8c0-1a39-4704-97c1-04489bd936cd,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:05.616787 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.617137 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.617458 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.617779 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.618094 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.618404 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.618712 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.619021 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.619350 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.619649 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.620194 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.621249 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91648) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:05.632094 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:05.643226 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Attempting to bind port 8aa5b8c0-1a39-4704-97c1-04489bd936cd on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:42:05.643587 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Attempting to bind port 8aa5b8c0-1a39-4704-97c1-04489bd936cd by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:42:05.643978 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Attempting to bind port 8aa5b8c0-1a39-4704-97c1-04489bd936cd on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:42:05.649885 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 41, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:42:05.650243 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Checking segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:42:05.650847 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.651390 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Bound using segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:42:05.652092 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Bound port: 8aa5b8c0-1a39-4704-97c1-04489bd936cd, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:42:05.652662 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.678745 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Notify callbacks [] for port, precommit_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.691015 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Transition to ACTIVE for port object e9162113-5422-4f6b-8d20-f165d3d4f0cc will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:05.717340 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Transition to ACTIVE for port object e9162113-5422-4f6b-8d20-f165d3d4f0cc will not be triggered until provisioned by entity DHCP. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:05.724692 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387'] for port, after_create {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.725326 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.728500 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:05.754172 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] For port 8aa5b8c0-1a39-4704-97c1-04489bd936cd, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:42:05.757439 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] For port 8aa5b8c0-1a39-4704-97c1-04489bd936cd, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=8aa5b8c0-1a39-4704-97c1-04489bd936cd,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:42:05.759347 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.763010 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.771233 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-97d4c5cb-3539-4eaf-ace4-dcd4be496e1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:05.806001 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c is already hosted by enough agents. {{(pid=91647) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:05.809380 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.scheduler.base_scheduler [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Resources bound (agent type, host, resource id): {{(pid=91647) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:05.813628 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Received port after_create {{(pid=91647) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:42:05.815735 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Pushing event updated for resources: {'Port': ['ID=e9162113-5422-4f6b-8d20-f165d3d4f0cc,revision_number=1']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:05.819593 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:05.848210 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:05.848835 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:41:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:05.925140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Allocated IP 172.27.3.114 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:42:05.927214 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Attempting to bind port e9162113-5422-4f6b-8d20-f165d3d4f0cc on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:42:05.928012 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Attempting to bind port e9162113-5422-4f6b-8d20-f165d3d4f0cc by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:42:05.929455 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Attempting to bind port e9162113-5422-4f6b-8d20-f165d3d4f0cc on network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:42:05.933237 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Pushing event updated for resources: {'Port': ['ID=8aa5b8c0-1a39-4704-97c1-04489bd936cd,revision_number=4']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:05.942809 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 41, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:42:05.943973 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Checking segment: {'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:42:05.946526 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.946526 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Bound using segment: {'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:42:05.946526 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Bound port: e9162113-5422-4f6b-8d20-f165d3d4f0cc, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:42:05.946526 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:05.949792 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-75a97b79-c4ae-4442-a7cb-42b63e6f4ea0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:06.068636 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] For port e9162113-5422-4f6b-8d20-f165d3d4f0cc, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:42:06.075152 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] For port e9162113-5422-4f6b-8d20-f165d3d4f0cc, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e9162113-5422-4f6b-8d20-f165d3d4f0cc,segment=NetworkSegment(807dfd29-e595-4465-a0fd-ac78b3a2c520),segment_id=807dfd29-e595-4465-a0fd-ac78b3a2c520)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:42:06.093362 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:06.101285 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-ded56bbb-681d-42f6-9401-d13c2f625aea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:06.112095 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:06.122149 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:06.151612 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 733a6917-9e40-4a57-8e84-63f60a792028 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:06.154423 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:06.159105 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-1746631a-5daf-4fe2-b118-c70c84749cb7 tempest-TestMinimumBasicScenario-1141490101 tempest-TestMinimumBasicScenario-1141490101-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:06.220832 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:06.225579 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:06.226939 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:42:06.270957 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Pushing event updated for resources: {'Port': ['ID=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:06.275374 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:06.286268 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Pushing event updated for resources: {'Port': ['ID=e9162113-5422-4f6b-8d20-f165d3d4f0cc,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:06.297310 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:06.299921 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 733a6917-9e40-4a57-8e84-63f60a792028 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:06.300293 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:06.445362 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:05Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:06.450439 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a595ad58-9564-4a8d-8417-0d41f4ac9690 None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:05Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:42:06.834463 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:07.195479 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-735120', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-662452'] for router, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:07.231939 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:07.307157 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9d2c7e0-c8e7-45e4-84d6-babf3fbb8a76 None None] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:42:07.427102 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-a6083d78-39d4-4dfd-b2f9-cc679b108592 None None] Provisioning for port e9162113-5422-4f6b-8d20-f165d3d4f0cc completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:07.435531 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f is scheduled to L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b with binding_index 1 {{(pid=91645) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 20 20:42:07.567157 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-76646a3d-b334-4635-925c-a0e21c66a46b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:07.624080 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:42:07.632719 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Sync routers for ids ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:42:07.643649 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Routers {'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:07.644619 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:42:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:07.662351 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] Notify callbacks [] for router, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:07.663942 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-2bc1d9b4-b1fe-4a9d-aaad-66a500e7d0a9 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.6470129 May 20 20:42:07.666701 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47214) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:07.831360 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Set router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:08.179945 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e9162113-5422-4f6b-8d20-f165d3d4f0cc up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:08.226820 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:06Z', 'revision_number': 3, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port': {'id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:0c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:08.237431 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Checking router: ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:42:08.238096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Updating router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 binding host dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:42:08.297336 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.357522 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port e9162113-5422-4f6b-8d20-f165d3d4f0cc completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:08.366590 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port e9162113-5422-4f6b-8d20-f165d3d4f0cc triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:08.366979 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.439976 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.492712 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.648565 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.702234 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Allocated IP 172.20.0.1 (ebd2ede6-2eb5-48d9-a114-c29ca4cd817c/2bb96e03-282c-4ec2-a1ec-d848893f9fca/51850bac-7b38-463f-8125-9c56224cfc79) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:42:08.704575 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port e9162113-5422-4f6b-8d20-f165d3d4f0cc, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e9162113-5422-4f6b-8d20-f165d3d4f0cc,segment=NetworkSegment(807dfd29-e595-4465-a0fd-ac78b3a2c520),segment_id=807dfd29-e595-4465-a0fd-ac78b3a2c520)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:08.718588 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.719421 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 8aa5b8c0-1a39-4704-97c1-04489bd936cd up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:08.748863 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:08.853178 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.869582 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.provisioning_blocks [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Transition to ACTIVE for port object 51850bac-7b38-463f-8125-9c56224cfc79 will not be triggered until provisioned by entity DHCP. {{(pid=91645) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:08.890728 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Notify callbacks [] for port, precommit_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.895494 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.900346 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-588058cc-56e3-4b32-8131-e7592c61edac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:08.909447 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Transition to ACTIVE for port object 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 will not be triggered until provisioned by entity L2. {{(pid=91647) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:08.911835 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=e9162113-5422-4f6b-8d20-f165d3d4f0cc,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:08.916802 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:08.921870 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:08.926115 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:08.960362 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 8aa5b8c0-1a39-4704-97c1-04489bd936cd completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:08.968675 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:08.971573 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:08.974193 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:42:08.984698 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 8aa5b8c0-1a39-4704-97c1-04489bd936cd triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:08.985080 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.019388 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Pushing event updated for resources: {'Port': ['ID=51850bac-7b38-463f-8125-9c56224cfc79,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:09.022767 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:09.046428 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-737197'] for router_interface, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.064666 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8384e8e8-3f6b-4af0-8dff-236fc6033cbb None None] Pushing event updated for resources: {'Port': ['ID=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,revision_number=2']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:09.070474 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-8384e8e8-3f6b-4af0-8dff-236fc6033cbb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:09.077655 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Attempting to bind port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:42:09.078029 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Attempting to bind port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:42:09.078392 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Attempting to bind port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 on network 86a15d61-a97a-4109-a08b-ca9231f239f9 {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:42:09.087716 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 42, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:42:09.088110 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Checking segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91647) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:42:09.088608 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.088934 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Bound using segment: {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'} {{(pid=91647) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:42:09.089577 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.managers [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Bound port: 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e154b7e6-c550-4790-a468-97d736bc8feb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9'}}] {{(pid=91647) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:42:09.090025 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.217715 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] For port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91647) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:42:09.221692 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] For port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:42:09.226534 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.240392 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.247276 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:09.306991 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.322347 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-351b0317-4778-45f3-9d2a-abb3137b7c46 None None] Provisioning for port 51850bac-7b38-463f-8125-9c56224cfc79 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:09.333091 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 8aa5b8c0-1a39-4704-97c1-04489bd936cd, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=8aa5b8c0-1a39-4704-97c1-04489bd936cd,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:09.340408 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-351b0317-4778-45f3-9d2a-abb3137b7c46 None None] Provisioning complete for port 51850bac-7b38-463f-8125-9c56224cfc79 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:09.340673 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-351b0317-4778-45f3-9d2a-abb3137b7c46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.375295 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.393748 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Routers {'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:09.394381 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:42:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:09.451306 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8384e8e8-3f6b-4af0-8dff-236fc6033cbb None None] Pushing event updated for resources: {'Port': ['ID=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,revision_number=3']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:09.465281 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-8384e8e8-3f6b-4af0-8dff-236fc6033cbb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:09.465281 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.080s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:09.533651 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-351b0317-4778-45f3-9d2a-abb3137b7c46 None None] Port 51850bac-7b38-463f-8125-9c56224cfc79 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:42:09.537653 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.543502 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3178412'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.574474 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:09.656254 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-752456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683030'] for router_interface, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:09.659866 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Pushing event updated for resources: {'Port': ['ID=51850bac-7b38-463f-8125-9c56224cfc79,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:09.662467 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=8aa5b8c0-1a39-4704-97c1-04489bd936cd,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:09.662907 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:09.668353 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:09.689150 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] Set router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:09.909156 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:09.910863 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:09.992559 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:10.037164 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 4, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port': {'id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:0c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '51850bac-7b38-463f-8125-9c56224cfc79', 'name': '', 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'mac_address': 'fa:16:3e:64:2e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:08Z', 'updated_at': '2021-05-20T20:42:08Z', 'revision_number': 1, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'subnets': [{'id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:10.042060 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54610d28-951e-4d0a-a062-e04f7b1e3b9b None None] The sync data for ids ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'] in dv-cinder-784623-13-iscsi is: [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 4, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port': {'id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:0c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '51850bac-7b38-463f-8125-9c56224cfc79', 'name': '', 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'mac_address': 'fa:16:3e:64:2e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:08Z', 'updated_at': '2021-05-20T20:42:08Z', 'revision_number': 1, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'subnets': [{'id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:42:10.122272 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:42:10.131516 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e9162113-5422-4f6b-8d20-f165d3d4f0cc up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:10.196460 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-a6daca8d-4b49-4df6-b172-3aebe8db90e1 None None] Provisioning complete for port 51850bac-7b38-463f-8125-9c56224cfc79 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:10.196838 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a6daca8d-4b49-4df6-b172-3aebe8db90e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:10.264521 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-a6daca8d-4b49-4df6-b172-3aebe8db90e1 None None] Port 51850bac-7b38-463f-8125-9c56224cfc79 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:42:10.274132 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port e9162113-5422-4f6b-8d20-f165d3d4f0cc triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:10.274716 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:10.351716 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:42:10.363033 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fc51651d-cc9f-48d3-abec-3d0eba141ef1 admin admin] 10.222.0.82 "PUT /v2.0/routers/ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6948979 May 20 20:42:10.423550 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 8aa5b8c0-1a39-4704-97c1-04489bd936cd up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:10.497237 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 8aa5b8c0-1a39-4704-97c1-04489bd936cd triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:10.497607 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.130750 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:12.170303 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47230) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:12.176147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1294408510', 'description': 'tempest-secgroup-smoke-1294408510 description', 'project_id': '0fc67707e21b4394989903515082b61d'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:12.181822 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:12.186025 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:12.188959 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:12.194802 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:12.200180 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:12.204882 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:12.205264 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.210524 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.232921 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:12.236681 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:12.239507 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:12.245155 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:12.317158 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.321135 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.324533 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.325267 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-cb1ec21c-34ca-434e-a4f0-60a70ae6733e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:12.341386 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:12.346251 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.348842 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-c145d159-ff9d-4faa-99a2-d8e341ba260f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:12.369695 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=68fab0cc-a704-4908-b5f6-79379e2689f7,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:12.374488 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:12.375719 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.379967 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-2b40c90f-0ec5-4bd8-97be-8e1f8ef3b3e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2055781 May 20 20:42:12.379967 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47234) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:12.385004 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'security_group_rule': {'security_group_id': '68fab0cc-a704-4908-b5f6-79379e2689f7', 'project_id': '0fc67707e21b4394989903515082b61d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:12.391942 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:12.395934 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:12.398905 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:12.405007 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:12.419104 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:12.422181 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:12.422908 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.488524 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.492046 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.494154 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:12.517984 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba9b22c4-5325-459d-8cb3-22741550c8ec,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:12.520507 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:12.527826 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.528968 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-8f80c88e-8d72-457d-a13f-f23c546db978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1481438 May 20 20:42:12.531626 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47238) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:12.537017 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'security_group_rule': {'security_group_id': '68fab0cc-a704-4908-b5f6-79379e2689f7', 'project_id': '0fc67707e21b4394989903515082b61d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:12.544545 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:12.550871 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:12.554689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:12.561768 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:12.577898 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.641927 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.645479 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.647471 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:12.670236 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8556d33d-6688-4bdb-b15d-0b21c25bb651,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:12.672645 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:12.680462 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.681633 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1490800 May 20 20:42:12.685479 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47244) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:12.690648 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'security_group_rule': {'security_group_id': '68fab0cc-a704-4908-b5f6-79379e2689f7', 'project_id': '0fc67707e21b4394989903515082b61d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:12.696609 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:12.700722 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:12.703566 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:12.710212 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:12.725708 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.788642 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.792687 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.800441 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:12.823537 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3dcf22df-0c52-49b0-bf86-9ac44e9bd0f4,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:12.825846 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:12.830472 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.831772 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-280b7907-39e8-416c-a820-682d0387fb42 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1453190 May 20 20:42:12.834533 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47248) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:12.839840 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'security_group_rule': {'security_group_id': '68fab0cc-a704-4908-b5f6-79379e2689f7', 'project_id': '0fc67707e21b4394989903515082b61d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:12.845637 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:12.849702 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:12.852681 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:12.859551 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:12.875961 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.939253 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.943301 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.949459 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:12.969147 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a37ba247-ba3b-46b3-b55b-b3847ada25c3,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:12.971995 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:12.979686 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:12.981445 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-3564daa1-f6ea-4d7f-a890-d603c49be0d0 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1459961 May 20 20:42:12.984319 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47252) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:12.989325 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'security_group_rule': {'security_group_id': '68fab0cc-a704-4908-b5f6-79379e2689f7', 'project_id': '0fc67707e21b4394989903515082b61d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:12.995089 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:12.998910 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:13.001769 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:13.007401 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:13.017626 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.securitygroups_db [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Project 0fc67707e21b4394989903515082b61d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 20 20:42:13.023044 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.090204 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.093851 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.095974 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-505218f3-69ab-4491-bb64-349744d690ec tempest-AttachVolumeTestJSON-2087350556 tempest-AttachVolumeTestJSON-2087350556-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:13.116943 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fb40a336-a7de-4316-a970-d7095b00ba87,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:13.119305 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:13.126422 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.127577 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-fd293968-8e27-4efc-9735-0b0948f0508f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1423588 May 20 20:42:13.130367 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47256) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:13.135579 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'security_group_rule': {'security_group_id': '68fab0cc-a704-4908-b5f6-79379e2689f7', 'project_id': '0fc67707e21b4394989903515082b61d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:13.141891 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:13.145620 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:security_group_rule and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:13.148432 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:13.154176 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:13.164662 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.securitygroups_db [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Project 0fc67707e21b4394989903515082b61d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 20 20:42:13.170543 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.239996 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.243584 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588073'] for security_group_rule, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.246307 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-add5d5bc-818e-4437-965c-ea4fe0b96f22 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:13.268363 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=15dbad54-115a-4501-97f9-f3eaaf0f211b,revision_number=0']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:13.270774 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:13.278530 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:13.279713 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-ceb7e50a-3919-4488-9f3a-a9c1ed391bee tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1482723 May 20 20:42:13.805913 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:42:13.883800 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Sync routers for ids ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:42:13.896057 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Routers {'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:13.896057 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:42:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:14.079239 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Set router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:14.111983 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:14.180687 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:14.181061 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:14.397337 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 4, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port': {'id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:0c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '51850bac-7b38-463f-8125-9c56224cfc79', 'name': '', 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'mac_address': 'fa:16:3e:64:2e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:08Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 2, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'subnets': [{'id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:14.401124 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Checking router: ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:42:14.401480 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Updating router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f port 51850bac-7b38-463f-8125-9c56224cfc79 binding host dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 20 20:42:14.461779 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:14.805113 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Notify callbacks [] for port, precommit_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:14.816123 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.provisioning_blocks [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Transition to ACTIVE for port object 51850bac-7b38-463f-8125-9c56224cfc79 will not be triggered until provisioned by entity L2. {{(pid=91648) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:14.821800 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:14.826035 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:14.952758 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac89c09d-7676-4ca4-80f3-361daaeea68f None None] Pushing event updated for resources: {'Port': ['ID=51850bac-7b38-463f-8125-9c56224cfc79,revision_number=3']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:14.984515 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-ac89c09d-7676-4ca4-80f3-361daaeea68f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:15.074192 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Attempting to bind port 51850bac-7b38-463f-8125-9c56224cfc79 on host dv-cinder-784623-13-iscsi for vnic_type normal with profile {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:42:15.074507 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Attempting to bind port 51850bac-7b38-463f-8125-9c56224cfc79 by drivers openvswitch,hyperv on host dv-cinder-784623-13-iscsi at level 0 using segments [{'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:42:15.074863 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Attempting to bind port 51850bac-7b38-463f-8125-9c56224cfc79 on network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:42:15.079939 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Checking agent: {'id': '9d174d81-213a-48ba-abc2-184c91a51bfb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784623-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 19, 7), 'started_at': datetime.datetime(2021, 5, 20, 20, 19, 37), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 42, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784623-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:42:15.080302 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Checking segment: {'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91648) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:42:15.080732 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:15.081076 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Bound using segment: {'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'} {{(pid=91648) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:42:15.081525 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.managers [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Bound port: 51850bac-7b38-463f-8125-9c56224cfc79, host: dv-cinder-784623-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '807dfd29-e595-4465-a0fd-ac78b3a2c520', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c'}}] {{(pid=91648) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:42:15.081884 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:15.147351 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:15.170622 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] For port 51850bac-7b38-463f-8125-9c56224cfc79, host dv-cinder-784623-13-iscsi, cleared binding levels {{(pid=91648) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:42:15.173725 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.plugins.ml2.db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] For port 51850bac-7b38-463f-8125-9c56224cfc79, host dv-cinder-784623-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=51850bac-7b38-463f-8125-9c56224cfc79,segment=NetworkSegment(807dfd29-e595-4465-a0fd-ac78b3a2c520),segment_id=807dfd29-e595-4465-a0fd-ac78b3a2c520)] {{(pid=91648) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:42:15.178646 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron_lib.callbacks.manager [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91648) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:15.182451 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:15.260124 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Routers {'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:15.260765 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:42:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:15.320251 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac89c09d-7676-4ca4-80f3-361daaeea68f None None] Pushing event updated for resources: {'Port': ['ID=51850bac-7b38-463f-8125-9c56224cfc79,revision_number=4']} {{(pid=91648) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:15.330787 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG oslo_concurrency.lockutils [None req-ac89c09d-7676-4ca4-80f3-361daaeea68f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:15.448966 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] Set router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:15.760692 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-5a816816-6971-4469-9d69-681a071d0878 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 4, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port': {'id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:0c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '51850bac-7b38-463f-8125-9c56224cfc79', 'name': '', 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'mac_address': 'fa:16:3e:64:2e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:08Z', 'updated_at': '2021-05-20T20:42:15Z', 'revision_number': 4, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'subnets': [{'id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:15.765358 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a816816-6971-4469-9d69-681a071d0878 None None] The sync data for ids ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'] in dv-cinder-784623-13-iscsi is: [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 4, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port': {'id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:0c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '51850bac-7b38-463f-8125-9c56224cfc79', 'name': '', 'network_id': 'ebd2ede6-2eb5-48d9-a114-c29ca4cd817c', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'mac_address': 'fa:16:3e:64:2e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:08Z', 'updated_at': '2021-05-20T20:42:15Z', 'revision_number': 4, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'subnets': [{'id': '2bb96e03-282c-4ec2-a1ec-d848893f9fca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:42:16.132125 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 51850bac-7b38-463f-8125-9c56224cfc79 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:16.206429 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning for port 51850bac-7b38-463f-8125-9c56224cfc79 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:16.211472 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 51850bac-7b38-463f-8125-9c56224cfc79 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:16.211889 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:16.330907 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:16.363496 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] For port 51850bac-7b38-463f-8125-9c56224cfc79, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=51850bac-7b38-463f-8125-9c56224cfc79,segment=NetworkSegment(807dfd29-e595-4465-a0fd-ac78b3a2c520),segment_id=807dfd29-e595-4465-a0fd-ac78b3a2c520)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:16.367068 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:16.370223 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:16.436921 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Pushing event updated for resources: {'Port': ['ID=51850bac-7b38-463f-8125-9c56224cfc79,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:16.440168 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:18.115874 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 51850bac-7b38-463f-8125-9c56224cfc79 up at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:18.195528 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Provisioning complete for port 51850bac-7b38-463f-8125-9c56224cfc79 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:18.195528 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:34.806200 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-58d0c250-2144-4c3c-b76c-69ea86f7dea5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:37.236689 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:37.329066 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-7df8bc84-ce50-4451-8899-471218e74950 req-afd5227f-171c-4f67-8b11-f3482f9f3a61 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:security_group {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:42:37.345595 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [req-7df8bc84-ce50-4451-8899-471218e74950 req-afd5227f-171c-4f67-8b11-f3482f9f3a61 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:security_group {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:42:37.346859 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-afd5227f-171c-4f67-8b11-f3482f9f3a61 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1294408510&fields=id&tenant_id=0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 267 time: 0.0570343 May 20 20:42:37.494687 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-3feed9a5-a720-4133-9926-0c9aedd867e7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:37.496132 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-3feed9a5-a720-4133-9926-0c9aedd867e7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 812 time: 0.1426570 May 20 20:42:37.510970 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-51d3b4ea-22d6-4eff-ab6e-5a1eef0c074b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/quotas/0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 375 time: 0.0090702 May 20 20:42:37.521099 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3449088e-6239-4f21-ac0c-55386b52e366 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:37.595358 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-de41a1ef-00ed-4ea1-aeb4-4679fb26bd21 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0783250 May 20 20:42:37.731975 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-4c510c05-8c69-4f80-bc7a-858fdbede839 service neutron] 10.222.0.82 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1255796 May 20 20:42:37.861780 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-cab4f3c0-5a93-47a2-a6aa-dada4cf879f1 service neutron] 10.222.0.82 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1232309 May 20 20:42:38.345668 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:38.362837 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-67f2b577-8dad-4ac9-8dd0-5caba8a92e8d req-7ce53b0e-c5d2-4547-bc23-a367432820bb tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:42:38.380945 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-67f2b577-8dad-4ac9-8dd0-5caba8a92e8d req-7ce53b0e-c5d2-4547-bc23-a367432820bb tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:42:38.382293 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-67f2b577-8dad-4ac9-8dd0-5caba8a92e8d req-7ce53b0e-c5d2-4547-bc23-a367432820bb tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 210 time: 0.1735919 May 20 20:42:39.567059 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-ad3d6383-16f4-41a4-bd17-0d452b306d10 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:39.567831 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7df8bc84-ce50-4451-8899-471218e74950 req-ad3d6383-16f4-41a4-bd17-0d452b306d10 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:network {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:42:39.586041 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7df8bc84-ce50-4451-8899-471218e74950 req-ad3d6383-16f4-41a4-bd17-0d452b306d10 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:network {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:42:39.587230 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-ad3d6383-16f4-41a4-bd17-0d452b306d10 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 812 time: 0.1791031 May 20 20:42:39.645075 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-385881d2-5b6c-4d86-bd17-0652c4bb1109 req-0ae37c65-c1f5-40f4-877c-7f71a0fce812 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 210 time: 0.1487594 May 20 20:42:39.652026 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7df8bc84-ce50-4451-8899-471218e74950 req-93be445d-1cad-4dfd-ab9e-78711da5c02e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:security_group {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:42:39.664212 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-7df8bc84-ce50-4451-8899-471218e74950 req-93be445d-1cad-4dfd-ab9e-78711da5c02e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:security_group {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:42:39.665343 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-93be445d-1cad-4dfd-ab9e-78711da5c02e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 380 time: 0.0640600 May 20 20:42:39.682789 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'port': {'device_id': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'admin_state_up': True, 'tenant_id': '0fc67707e21b4394989903515082b61d', 'security_groups': ['68fab0cc-a704-4908-b5f6-79379e2689f7']}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:39.819528 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:39.828690 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:39.838496 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Made reservation on behalf of 0fc67707e21b4394989903515082b61d for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:42:39.842244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:39.951101 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:40.006165 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Allocated IP 172.20.0.13 (9997745d-f55f-4dcf-a08c-5d192080ee30/5f15ab56-6f84-44c6-ba41-332f6baa9746/33966448-223d-4d24-bee8-c58c1df4e30d) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:42:40.194750 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:40.210372 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Transition to ACTIVE for port object 33966448-223d-4d24-bee8-c58c1df4e30d will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:40.235400 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:40.240944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5f109a66-abe2-403e-b287-f37246c662a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:40.306510 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:40.309555 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:40.313435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:42:40.348724 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=33966448-223d-4d24-bee8-c58c1df4e30d,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:40.353446 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:40.385150 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:40.385780 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:40.413613 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7344277 May 20 20:42:40.434044 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Request body: {'port': {'device_id': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:40.545042 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-627348c9-42af-4de0-a8b4-99bf75147931 None None] Provisioning for port 33966448-223d-4d24-bee8-c58c1df4e30d completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:40.550822 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-627348c9-42af-4de0-a8b4-99bf75147931 None None] Provisioning complete for port 33966448-223d-4d24-bee8-c58c1df4e30d triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:40.551307 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-627348c9-42af-4de0-a8b4-99bf75147931 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:40.603173 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-627348c9-42af-4de0-a8b4-99bf75147931 None None] Port 33966448-223d-4d24-bee8-c58c1df4e30d cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:42:40.649471 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:40.951327 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f3ee1b-71d1-44de-8c68-c6787a68c8e3 req-6091b15b-b1f1-48dd-ab0a-17baac8a0456 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:40.952043 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-20f3ee1b-71d1-44de-8c68-c6787a68c8e3 req-6091b15b-b1f1-48dd-ab0a-17baac8a0456 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:42:40.985738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-20f3ee1b-71d1-44de-8c68-c6787a68c8e3 req-6091b15b-b1f1-48dd-ab0a-17baac8a0456 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:42:40.986878 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20f3ee1b-71d1-44de-8c68-c6787a68c8e3 req-6091b15b-b1f1-48dd-ab0a-17baac8a0456 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 932 time: 0.2269311 May 20 20:42:41.046907 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-20f3ee1b-71d1-44de-8c68-c6787a68c8e3 req-e82011fc-3123-4935-bc98-fea226a12910 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535157 May 20 20:42:41.102683 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 33966448-223d-4d24-bee8-c58c1df4e30d {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:42:41.110373 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:41.124609 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Transition to ACTIVE for port object 33966448-223d-4d24-bee8-c58c1df4e30d will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:42:41.128380 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:41.131929 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:41.280586 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Pushing event updated for resources: {'Port': ['ID=33966448-223d-4d24-bee8-c58c1df4e30d,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:41.288603 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:41.363435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Attempting to bind port 33966448-223d-4d24-bee8-c58c1df4e30d on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:42:41.363786 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Attempting to bind port 33966448-223d-4d24-bee8-c58c1df4e30d by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:42:41.364112 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Attempting to bind port 33966448-223d-4d24-bee8-c58c1df4e30d on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:42:41.368692 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Port 33966448-223d-4d24-bee8-c58c1df4e30d on network 9997745d-f55f-4dcf-a08c-5d192080ee30 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:42:41.369005 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Attempting to bind port 33966448-223d-4d24-bee8-c58c1df4e30d on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:42:41.373980 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 42, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:42:41.374307 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Checking segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:42:41.374682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Bound using segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:42:41.375705 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Bound port: 33966448-223d-4d24-bee8-c58c1df4e30d, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:42:41.376076 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:41.464096 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] For port 33966448-223d-4d24-bee8-c58c1df4e30d, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:42:41.466852 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] For port 33966448-223d-4d24-bee8-c58c1df4e30d, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=33966448-223d-4d24-bee8-c58c1df4e30d,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:42:41.471424 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:41.475154 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d38a0122-ef3c-4767-b67e-b5df2d4b80c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:41.528423 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:41.529036 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:41.530539 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] 10.222.0.69 "PUT /v2.0/ports/33966448-223d-4d24-bee8-c58c1df4e30d HTTP/1.1" status: 200 len: 1094 time: 1.1009009 May 20 20:42:41.533706 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:42:41.557971 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Pushing event updated for resources: {'Port': ['ID=33966448-223d-4d24-bee8-c58c1df4e30d,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:41.561262 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:41.620374 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d', 'status': 'completed', 'code': 200} May 20 20:42:41.663704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-157fb224-b5f9-4908-9218-71720f66d596 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:41.665190 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-157fb224-b5f9-4908-9218-71720f66d596 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 1097 time: 0.0812738 May 20 20:42:41.746447 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-15f28152-52dd-4e21-bed0-2ae5e118235c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33966448-223d-4d24-bee8-c58c1df4e30d HTTP/1.1" status: 200 len: 217 time: 0.0659230 May 20 20:42:41.815260 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-127262c6-4a19-46d4-8577-b810db75529f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:41.816606 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-127262c6-4a19-46d4-8577-b810db75529f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0587394 May 20 20:42:41.895012 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df8bc84-ce50-4451-8899-471218e74950 req-8310fc56-4824-4e44-949f-a6512b95591d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:41.896411 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-8310fc56-4824-4e44-949f-a6512b95591d service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0683837 May 20 20:42:42.034110 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-df103c94-f161-4801-9ce4-db252f1b1a71 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251166 May 20 20:42:42.307669 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-7df8bc84-ce50-4451-8899-471218e74950 req-261df90c-4230-474c-a74e-1d31937ba468 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2606041 May 20 20:42:42.341173 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-765a418f-6474-4d85-abc5-c77815ff7b55 req-7aae1668-acc4-40e2-8826-64867b89b567 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:42.342594 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-765a418f-6474-4d85-abc5-c77815ff7b55 req-7aae1668-acc4-40e2-8826-64867b89b567 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 944 time: 0.1920748 May 20 20:42:42.427981 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-765a418f-6474-4d85-abc5-c77815ff7b55 req-b0884e84-1bb2-412d-91e6-37fb023d9dd5 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0790663 May 20 20:42:42.455384 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-8bf9d8f5-b24c-46c4-b824-91ed4f063607 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:42.456864 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-8bf9d8f5-b24c-46c4-b824-91ed4f063607 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 1097 time: 0.0875754 May 20 20:42:42.593413 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-e03cedb7-9022-44ed-96dc-6b35c1c2cee6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:42.595647 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-e03cedb7-9022-44ed-96dc-6b35c1c2cee6 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1271501 May 20 20:42:42.671314 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-38d57a2d-02b3-4bf5-a5d3-b15d58cf4822 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33966448-223d-4d24-bee8-c58c1df4e30d HTTP/1.1" status: 200 len: 217 time: 0.0628648 May 20 20:42:42.739046 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-3bdf3862-2c43-4f17-a43f-abfa63deae9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:42.740490 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-3bdf3862-2c43-4f17-a43f-abfa63deae9d service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0570061 May 20 20:42:42.804516 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [req-eab8344f-60bc-49c7-9bd8-65a0970c9cf3 req-5c4ba841-ac4d-4bc4-b1fd-2da59f149b7e service neutron] (91645) timed out ('10.222.0.69', 52463) {{(pid=91645) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 20 20:42:42.825340 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-4baeff26-c9a2-4017-910c-386ec2b542cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:42.826802 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-4baeff26-c9a2-4017-910c-386ec2b542cf service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0733085 May 20 20:42:42.963689 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-cd14c7ef-70bc-4f7f-8bca-fa0d246727a4 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1242788 May 20 20:42:43.100483 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6d27518c-8fff-4f34-84b1-ddec2afe0a59 req-9d94b9ac-cf1d-4781-9dff-1e9e2486f5c2 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236899 May 20 20:42:43.615790 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fbb77f6-a1c8-4180-9074-dd03c35ad87d req-162452ed-814f-497c-a1fd-b5b317693605 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:43.617246 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2fbb77f6-a1c8-4180-9074-dd03c35ad87d req-162452ed-814f-497c-a1fd-b5b317693605 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 944 time: 0.0814981 May 20 20:42:43.666066 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-2fbb77f6-a1c8-4180-9074-dd03c35ad87d req-2a1ef795-0890-4298-b80b-0066b055059b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431507 May 20 20:42:44.852177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a5a7a7-d322-488f-a8d7-321f7c9e7baa req-2e86e78e-591a-4550-8b30-b8e7f4d34805 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:44.853618 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-32a5a7a7-d322-488f-a8d7-321f7c9e7baa req-2e86e78e-591a-4550-8b30-b8e7f4d34805 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 944 time: 0.0810115 May 20 20:42:44.898797 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-32a5a7a7-d322-488f-a8d7-321f7c9e7baa req-1191e614-9dcf-427e-b6be-aa23284e9630 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394061 May 20 20:42:45.156889 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:46.081864 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0508fffc-6da0-43f6-ac64-f03c4e5d60f5 req-0171cdfd-c726-4487-9974-9e309ae8505f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:46.083306 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0508fffc-6da0-43f6-ac64-f03c4e5d60f5 req-0171cdfd-c726-4487-9974-9e309ae8505f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 944 time: 0.0797236 May 20 20:42:46.127402 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0508fffc-6da0-43f6-ac64-f03c4e5d60f5 req-1bc3d83e-cf4d-4d66-8ed2-ba01e393cb9f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382328 May 20 20:42:47.314400 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb957ef8-e77a-46d3-9081-a4b42845cc53 req-aa79800e-b8f6-4ec7-99f6-b7b400f59ef4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:47.315863 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fb957ef8-e77a-46d3-9081-a4b42845cc53 req-aa79800e-b8f6-4ec7-99f6-b7b400f59ef4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 944 time: 0.0843534 May 20 20:42:47.358815 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-fb957ef8-e77a-46d3-9081-a4b42845cc53 req-a7cbfa97-004f-4c91-ab7a-6ead68c6b93a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373027 May 20 20:42:48.548527 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bef6cc1-9803-4a0d-8b6a-3d446569ce11 req-92eac4d6-b761-4ac0-b75c-b8f01e62acb6 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:48.550024 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4bef6cc1-9803-4a0d-8b6a-3d446569ce11 req-92eac4d6-b761-4ac0-b75c-b8f01e62acb6 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 944 time: 0.0865266 May 20 20:42:48.594710 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4bef6cc1-9803-4a0d-8b6a-3d446569ce11 req-632c7488-e530-46c8-91f3-930578219d4c tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389612 May 20 20:42:49.787726 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 33966448-223d-4d24-bee8-c58c1df4e30d details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:42:49.788975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76e52ac-6d74-4874-9dce-c1551575063b req-1ac35392-7af9-4f6c-9fc8-f38ea48974e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:49.790446 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f76e52ac-6d74-4874-9dce-c1551575063b req-1ac35392-7af9-4f6c-9fc8-f38ea48974e4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 944 time: 0.0907521 May 20 20:42:49.837784 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f76e52ac-6d74-4874-9dce-c1551575063b req-7cd42012-aded-4a5e-ac3c-5fe5b2cc7ecf tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412679 May 20 20:42:49.920519 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 33966448-223d-4d24-bee8-c58c1df4e30d, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=33966448-223d-4d24-bee8-c58c1df4e30d,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:49.934603 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': '33966448-223d-4d24-bee8-c58c1df4e30d', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'port_id': '33966448-223d-4d24-bee8-c58c1df4e30d', 'mac_address': 'fa:16:3e:02:a8:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 830, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:42:49.992546 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:50.009909 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 33966448-223d-4d24-bee8-c58c1df4e30d {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:42:50.026116 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 33966448-223d-4d24-bee8-c58c1df4e30d, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=33966448-223d-4d24-bee8-c58c1df4e30d,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:50.030319 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:50.032236 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:50.097836 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=33966448-223d-4d24-bee8-c58c1df4e30d,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:50.100944 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:50.354423 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['33966448-223d-4d24-bee8-c58c1df4e30d'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:42:50.804572 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:42:51.024358 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1528f4ff-579e-4ba5-882e-2963461d0300 req-3d78ba2e-75ec-4629-9d4c-cc22ab8b5844 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:51.025796 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1528f4ff-579e-4ba5-882e-2963461d0300 req-3d78ba2e-75ec-4629-9d4c-cc22ab8b5844 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 945 time: 0.0781868 May 20 20:42:51.071297 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1528f4ff-579e-4ba5-882e-2963461d0300 req-00b956f5-c719-415c-8924-613b332f90ad tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396559 May 20 20:42:51.788970 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 33966448-223d-4d24-bee8-c58c1df4e30d up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:42:51.854271 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port 33966448-223d-4d24-bee8-c58c1df4e30d completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:42:51.858698 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port 33966448-223d-4d24-bee8-c58c1df4e30d triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:42:51.859611 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:51.973537 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:51.999328 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:42:52.009467 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port 33966448-223d-4d24-bee8-c58c1df4e30d, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=33966448-223d-4d24-bee8-c58c1df4e30d,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:42:52.013275 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:52.015046 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:52.050475 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d', 'code': 200} May 20 20:42:52.082692 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=33966448-223d-4d24-bee8-c58c1df4e30d,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:52.085590 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:52.268703 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb497d8-4c88-40f1-9aec-7d768bd9dc89 req-a7679555-58ac-41c7-8b78-000f8e182e2b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:52.270553 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9eb497d8-4c88-40f1-9aec-7d768bd9dc89 req-a7679555-58ac-41c7-8b78-000f8e182e2b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0911710 May 20 20:42:52.316654 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9eb497d8-4c88-40f1-9aec-7d768bd9dc89 req-8e1d1926-a247-43cb-83e3-570dec414e8e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402012 May 20 20:42:52.383313 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-959d0291-0fdc-44fd-9ad0-ba1b6b98a5ea req-ccb7954d-e8e5-47b8-acfe-6735dfa27b5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:52.384783 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-959d0291-0fdc-44fd-9ad0-ba1b6b98a5ea req-ccb7954d-e8e5-47b8-acfe-6735dfa27b5f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 1099 time: 0.0690885 May 20 20:42:52.429826 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-959d0291-0fdc-44fd-9ad0-ba1b6b98a5ea req-d88d6d36-6ed2-4db4-9fdc-9eca6d2b782f service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0351138 May 20 20:42:53.507287 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088e4e94-f678-4dc8-b282-6264d5ce9706 req-438a862b-e64a-45e3-8aa0-9fd8da7ad4b1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:53.508666 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-088e4e94-f678-4dc8-b282-6264d5ce9706 req-438a862b-e64a-45e3-8aa0-9fd8da7ad4b1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0822730 May 20 20:42:53.555351 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-088e4e94-f678-4dc8-b282-6264d5ce9706 req-508ae53c-e3ba-40fa-829a-9869f75ea583 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409696 May 20 20:42:54.745150 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97bef50e-2014-4d18-b807-5ec94ed8e43f req-6d508c0a-9e77-4fcd-8375-c7f78f96bec8 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:54.746577 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97bef50e-2014-4d18-b807-5ec94ed8e43f req-6d508c0a-9e77-4fcd-8375-c7f78f96bec8 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0825424 May 20 20:42:54.790606 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97bef50e-2014-4d18-b807-5ec94ed8e43f req-18216937-fdf3-4086-b70f-2113b45dab1a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377574 May 20 20:42:54.973171 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62becd54-6ffb-4ef9-9839-67c22aa77ac1 req-af07a88c-e4b5-463f-b9f4-9fb38c50eec1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:54.974638 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62becd54-6ffb-4ef9-9839-67c22aa77ac1 req-af07a88c-e4b5-463f-b9f4-9fb38c50eec1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0808079 May 20 20:42:55.021876 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-62becd54-6ffb-4ef9-9839-67c22aa77ac1 req-fa210b35-8684-4480-ae34-2a6e00081fa6 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415523 May 20 20:42:55.045420 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47434) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:55.161812 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-579d29ff-bda5-483b-87ce-e18e157d1e03 tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:55.162510 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-579d29ff-bda5-483b-87ce-e18e157d1e03 tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] Synchronizing usage tracker for tenant:e033980e044a4e7bbdb78184080166be on resource:port {{(pid=91645) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:42:55.180519 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-579d29ff-bda5-483b-87ce-e18e157d1e03 tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] Unset dirty status for tenant:e033980e044a4e7bbdb78184080166be on resource:port {{(pid=91645) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:42:55.181660 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-579d29ff-bda5-483b-87ce-e18e157d1e03 tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 1094 time: 0.1352248 May 20 20:42:55.184536 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47440) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:42:55.189827 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'port_id': '33966448-223d-4d24-bee8-c58c1df4e30d', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address': '172.20.0.13'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:42:55.195569 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:42:55.199345 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:floatingip and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:42:55.202121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:42:55.208955 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:42:55.219516 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:55.358383 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:55.496396 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Allocated IP 172.27.3.131 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/eed294dc-d97b-4845-af8b-b8aacd3b21a1) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:42:55.641888 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:55.672852 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:55.677392 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-0991dfaa-444f-4fb8-9ba2-ce3b01cd9519 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:55.737956 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:42:55.740790 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:42:55.744389 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:42:55.783581 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=eed294dc-d97b-4845-af8b-b8aacd3b21a1,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:55.787656 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:56.264188 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:56.337580 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:56.548437 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:56.552763 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3178412'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:56.557010 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:42:56.663774 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=eed294dc-d97b-4845-af8b-b8aacd3b21a1,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:42:56.676341 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.676725 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.677097 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.677464 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.677854 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.678216 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.678577 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.678936 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.679295 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.679650 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.680035 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.680387 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:42:56.685397 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:42:56.686267 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:56.855015 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.l3_db [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Floating IP adc130da-76ab-4492-b210-68e3afed3e87 associated. External IP: 172.27.3.131, port: 33966448-223d-4d24-bee8-c58c1df4e30d. May 20 20:42:57.200625 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:42:57.379986 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:42:57.389420 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:42:57.400102 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:57.400724 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:42:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:57.406649 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:42:57.461927 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-166334ee-f0c9-49dc-aef5-03883108200d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.2762356 May 20 20:42:57.462502 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:42:57.565892 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d', 'status': 'completed', 'code': 200} May 20 20:42:57.585576 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:57.670454 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-9bf7e690-82d2-4967-bea1-f1163bac93cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:57.673170 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-9bf7e690-82d2-4967-bea1-f1163bac93cc service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 1099 time: 0.0735607 May 20 20:42:57.817435 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-2750f1a5-065a-4b4f-b1dd-9aa4a59ed57f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:57.818781 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-2750f1a5-065a-4b4f-b1dd-9aa4a59ed57f service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1333039 May 20 20:42:57.965483 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'adc130da-76ab-4492-b210-68e3afed3e87', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.131', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': '33966448-223d-4d24-bee8-c58c1df4e30d', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:02:a8:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:42:56Z', 'updated_at': '2021-05-20T20:42:56Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:57.971050 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:42:57.979625 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:42:57.980289 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:42:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:58.020831 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-9f628662-2c69-4bd6-83c8-ad74a4c9ebaa service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33966448-223d-4d24-bee8-c58c1df4e30d HTTP/1.1" status: 200 len: 1000 time: 0.1898236 May 20 20:42:58.087825 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-3dfa8977-93d7-4751-a397-b165b5a67b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:58.089251 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-3dfa8977-93d7-4751-a397-b165b5a67b27 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0572312 May 20 20:42:58.159506 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:42:58.175926 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-5c86977f-b7dc-4525-aa39-4667d82d575b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:42:58.177432 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-5c86977f-b7dc-4525-aa39-4667d82d575b service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0768573 May 20 20:42:58.319713 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-2f2b1bc2-0b08-40ae-ba5b-57bfa095fd48 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1298354 May 20 20:42:58.454165 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2e2dc27c-e359-4493-a79d-712166e10f90 req-7575ee93-c830-4c17-a662-9b98cd7b5e86 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1232946 May 20 20:42:58.513450 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'adc130da-76ab-4492-b210-68e3afed3e87', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.131', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': '33966448-223d-4d24-bee8-c58c1df4e30d', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:02:a8:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:42:56Z', 'updated_at': '2021-05-20T20:42:56Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:42:58.517847 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c246127a-a5ee-4679-9ba7-3d88b504b4c5 None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'adc130da-76ab-4492-b210-68e3afed3e87', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.131', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': '33966448-223d-4d24-bee8-c58c1df4e30d', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:02:a8:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:42:56Z', 'updated_at': '2021-05-20T20:42:56Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:42:58.696861 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adc5c40b-dea0-41fe-ba6e-c77a30d4cee8 None None] New status for floating IP adc130da-76ab-4492-b210-68e3afed3e87: ACTIVE {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:43:04.808609 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-94abf412-0a0f-4117-bb85-8947fe1e8c7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:07.232405 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:07.522993 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b5b0e790-f20a-4cf3-897c-f026acfb372d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:08.349093 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:09.954679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:15.170687 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:17.350949 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-235fa2cb-4b55-497d-b3d3-1f7cde0dcbbc service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1138985 May 20 20:43:17.507332 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-0fa1cfee-9e62-4b5d-b133-5134cf9e2469 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:43:17.508715 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-0fa1cfee-9e62-4b5d-b133-5134cf9e2469 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 1099 time: 0.0701215 May 20 20:43:17.665645 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-af12e174-3c7a-445f-8b25-1842207599b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:43:17.667088 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-af12e174-3c7a-445f-8b25-1842207599b3 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1265614 May 20 20:43:17.776079 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-04e8b98f-b388-43b9-b779-9d09dbdbb960 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33966448-223d-4d24-bee8-c58c1df4e30d HTTP/1.1" status: 200 len: 1002 time: 0.0962696 May 20 20:43:17.847449 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-e0d0e278-f7ca-4b0c-9f04-0349779e8dc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:43:17.848948 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-e0d0e278-f7ca-4b0c-9f04-0349779e8dc2 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0618014 May 20 20:43:17.928798 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-0205cd7d-d71b-442f-bc70-8df5b6635507 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:43:17.930259 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-0205cd7d-d71b-442f-bc70-8df5b6635507 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0693359 May 20 20:43:18.068335 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-090a335c-d7ac-4d4b-84bb-6937329968c4 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240952 May 20 20:43:18.207192 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8e6f640e-0884-44ee-aefc-8e6befe8e8c2 req-2f96a63f-1b7e-4071-b9ce-50c014dbb753 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273170 May 20 20:43:27.802729 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:43:34.811637 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-55c92263-7f9b-418e-b881-c37ca5077245 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:37.234962 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:37.524929 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-fc744a01-490f-4aa9-b59a-297e017b7115 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:38.352261 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:39.956947 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:43:45.175568 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:04.801886 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:44:04.814053 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-07096847-3760-4cea-bebd-c2c21e3fe355 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:07.238175 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:07.527705 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0e5ad857-b692-43cf-bc3c-786918a1cb5c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:08.354887 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:09.959817 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:15.178161 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:19.304672 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-726fa4b5-2fe6-4814-961c-ad002ce4a115 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0807755 May 20 20:44:19.470960 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1047c244-4548-4803-826e-65a7704d3aa9 req-cc0fe7f2-9464-41ec-8109-12ce2fba964a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:44:19.472461 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-cc0fe7f2-9464-41ec-8109-12ce2fba964a service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 1099 time: 0.0808580 May 20 20:44:19.624976 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1047c244-4548-4803-826e-65a7704d3aa9 req-1ab18c98-deca-478b-ba3b-4eba67bd6bfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:44:19.626420 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-1ab18c98-deca-478b-ba3b-4eba67bd6bfa service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1263514 May 20 20:44:19.831379 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-402498ea-b5a8-4e0b-a95f-48ae9d2b8945 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33966448-223d-4d24-bee8-c58c1df4e30d HTTP/1.1" status: 200 len: 1002 time: 0.1933527 May 20 20:44:19.897431 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1047c244-4548-4803-826e-65a7704d3aa9 req-b6670cdb-619e-40eb-a741-6fbeb31ad138 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:44:19.898848 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-b6670cdb-619e-40eb-a741-6fbeb31ad138 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0564284 May 20 20:44:19.982982 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1047c244-4548-4803-826e-65a7704d3aa9 req-aec2d22f-16b8-4694-8444-72524e6725df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:44:19.984542 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-aec2d22f-16b8-4694-8444-72524e6725df service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0731621 May 20 20:44:20.120904 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-706a2c41-e2da-4a1a-a88a-831edf5a3745 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237373 May 20 20:44:20.258433 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1047c244-4548-4803-826e-65a7704d3aa9 req-8e66b853-e082-42ee-946d-698c21f524ce service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1245463 May 20 20:44:34.816165 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3e66004b-4b51-41d9-999c-274cbb165cb2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:37.240461 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:37.529553 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-f85f4b1f-e611-4197-bd6d-1a69e1454023 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:38.357364 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:39.963009 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:44:41.800553 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:44:45.186872 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:04.818733 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-bcebf0f6-e96f-4c17-89c5-aea5fcef78d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:07.241501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:07.533258 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0c5efbd7-77bd-4ae5-95c9-a5944a28fc89 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:08.359990 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:09.968132 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:10.131134 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [req-11e71d8f-9b55-4185-b26a-a8c47efd5cfe req-c03f95b3-4768-4ef7-8f2f-75f4a3c8fbc0 service neutron] (91645) timed out ('10.222.0.69', 52498) {{(pid=91645) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 20 20:45:15.189992 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:15.738025 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ccddc9-086c-4b87-adda-47d0cb980be0 req-f3dcdfef-a9ee-461c-8f00-d3fee617d567 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:15.739486 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e7ccddc9-086c-4b87-adda-47d0cb980be0 req-f3dcdfef-a9ee-461c-8f00-d3fee617d567 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0854313 May 20 20:45:15.786682 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e7ccddc9-086c-4b87-adda-47d0cb980be0 req-f18c30ad-a1d7-40ee-a8d6-21df8fb754a4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397940 May 20 20:45:16.991551 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398242eb-0da4-4115-a1c4-7b684b452e2f req-091197d7-7218-4fca-9e59-d393a49de30a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:16.992989 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-398242eb-0da4-4115-a1c4-7b684b452e2f req-091197d7-7218-4fca-9e59-d393a49de30a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0806990 May 20 20:45:17.037348 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-398242eb-0da4-4115-a1c4-7b684b452e2f req-52d32b54-f17c-40de-8c43-d79fb6a181ea tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386784 May 20 20:45:17.929573 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-b49ace46-867f-46c7-a5fc-0185b4081270 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:17.931106 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-b49ace46-867f-46c7-a5fc-0185b4081270 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0809596 May 20 20:45:18.070277 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Deleting port 33966448-223d-4d24-bee8-c58c1df4e30d {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:45:18.070861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:18.203363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] For port 33966448-223d-4d24-bee8-c58c1df4e30d, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=33966448-223d-4d24-bee8-c58c1df4e30d,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:45:18.203707 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:18.220691 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38bccd18-3895-4258-b733-98dd73590863 req-7e67e137-c1e3-425b-a41e-9166ee3742b3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:18.222142 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-38bccd18-3895-4258-b733-98dd73590863 req-7e67e137-c1e3-425b-a41e-9166ee3742b3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 946 time: 0.0815625 May 20 20:45:18.373849 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-38bccd18-3895-4258-b733-98dd73590863 req-a06614d6-d7e3-41f8-ab7e-9a6f8d08a864 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1456683 May 20 20:45:18.502333 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:18.502732 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:18.503093 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Floating IP adc130da-76ab-4492-b210-68e3afed3e87 disassociated. External IP: 172.27.3.131, port: 33966448-223d-4d24-bee8-c58c1df4e30d. May 20 20:45:18.503577 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Calling delete_port for 33966448-223d-4d24-bee8-c58c1df4e30d owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:45:18.617579 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:18.624010 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f4b9afb9-a907-4785-b771-b1f2f3314525 tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:18.673792 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event deleted for resources: {'Port': ['ID=33966448-223d-4d24-bee8-c58c1df4e30d,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:18.685599 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.685981 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.686347 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.686712 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.687070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.687426 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.687805 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.688163 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.688518 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.688871 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.689224 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.689564 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:18.693727 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:18.799318 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:45:19.003652 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:45:19.204854 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:45:19.214456 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:45:19.224106 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:45:19.224735 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:45:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:19.286011 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] No DVR routers for this DVR port 33966448-223d-4d24-bee8-c58c1df4e30d on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:45:19.288559 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:19.292256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'name': 'network-vif-deleted', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:45:19.316038 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ceb8b2bb-e1c8-4173-a10a-34e56c7e96c0 req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "DELETE /v2.0/ports/33966448-223d-4d24-bee8-c58c1df4e30d HTTP/1.1" status: 204 len: 173 time: 1.3752687 May 20 20:45:19.425801 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7', 'name': 'network-vif-deleted', 'tag': '33966448-223d-4d24-bee8-c58c1df4e30d', 'status': 'completed', 'code': 200} May 20 20:45:19.468594 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:45:19.537265 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-40832207-c4ad-4b31-b850-27abd803e63e req-433ff8eb-c5e2-490d-81a5-d494f8923fe8 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 210 time: 0.0439873 May 20 20:45:19.806816 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:19.810999 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:45:19.819509 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:45:19.820230 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:45:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:20.002564 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:45:20.282810 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66603345-4ba9-46b8-825c-1a28381dbc87 req-c3dc1694-7c6b-4366-a987-91b9871b0251 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0422730 May 20 20:45:20.312191 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:20.316090 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7da641ee-d33f-4610-b247-3f9d1394fafa None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:45:20.431652 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66603345-4ba9-46b8-825c-1a28381dbc87 req-366e5895-eb43-40b9-8eb6-2e5167938f1b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=991fa037-b6d4-4fb1-b04c-a9d8db7dbaf7 HTTP/1.1" status: 200 len: 210 time: 0.0459411 May 20 20:45:20.557100 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0936b662-2a36-47e2-81ea-e9eb06b49987 None None] New status for floating IP adc130da-76ab-4492-b210-68e3afed3e87: DOWN {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:45:20.620283 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66603345-4ba9-46b8-825c-1a28381dbc87 req-0d066378-56e6-4d90-8b8b-28f704bfc993 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:20.621210 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66603345-4ba9-46b8-825c-1a28381dbc87 req-0d066378-56e6-4d90-8b8b-28f704bfc993 service neutron] 10.222.0.69 "GET /v2.0/networks?tenant_id=0fc67707e21b4394989903515082b61d&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1493559 May 20 20:45:20.627370 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 33966448-223d-4d24-bee8-c58c1df4e30d no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:45:20.667272 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: 33966448-223d-4d24-bee8-c58c1df4e30d {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:45:20.667720 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device 33966448-223d-4d24-bee8-c58c1df4e30d not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:45:20.779408 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66603345-4ba9-46b8-825c-1a28381dbc87 req-61f87ed1-18d4-4e8e-9958-6fbc567d4e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:20.781061 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-66603345-4ba9-46b8-825c-1a28381dbc87 req-61f87ed1-18d4-4e8e-9958-6fbc567d4e71 service neutron] 10.222.0.69 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1441805 May 20 20:45:20.850760 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-67a8d4f4-c5e6-44d6-b133-b46d47824738 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1294408510&fields=id&tenant_id=0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 267 time: 0.0410876 May 20 20:45:21.001611 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-de37fbd9-16a8-42d2-9267-818ae608a73e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:21.002936 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-de37fbd9-16a8-42d2-9267-818ae608a73e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 812 time: 0.1426206 May 20 20:45:21.017463 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-5c2ea17c-bcd0-489f-bed0-612381300e31 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/quotas/0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 375 time: 0.0089605 May 20 20:45:21.105655 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-d2e0fcb9-2911-44c4-b3e2-b9d59e58cb39 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0832086 May 20 20:45:21.289056 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-19d25e81-4533-474c-8d05-594a01dafccb service neutron] 10.222.0.82 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1715839 May 20 20:45:21.420379 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-1cba6a4a-f2bc-47cb-9369-5087a106a725 service neutron] 10.222.0.82 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1249256 May 20 20:45:22.836538 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-2359bc12-7529-4dc8-974d-55a18f5b90ec req-20adb55b-4027-41c2-b7dc-15956e35a911 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:45:22.851944 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-2359bc12-7529-4dc8-974d-55a18f5b90ec req-20adb55b-4027-41c2-b7dc-15956e35a911 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:45:22.853755 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2359bc12-7529-4dc8-974d-55a18f5b90ec req-20adb55b-4027-41c2-b7dc-15956e35a911 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 210 time: 0.0584204 May 20 20:45:23.949367 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-dca564a1-d113-4e46-b3bb-9c21af9bc08e req-135eb8a5-6b9e-4d45-9ef5-dbdda876756f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 210 time: 0.0436914 May 20 20:45:25.051079 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-30ed830a-dcef-4f54-a485-a0780bb58c3a req-5f26851c-3d51-4d58-8114-6b56319140b9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 210 time: 0.0436590 May 20 20:45:26.144121 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-1641a6a1-1a6c-48ef-bbe7-f6f6832f0118 req-4c593e5b-da07-481d-b4ff-a574f283b9ea tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 210 time: 0.0415692 May 20 20:45:27.297803 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-5dadb4cc-4de9-416e-962d-69cd0cbf6659 req-43646cc8-5189-4904-8afb-998e3b2fcae2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 210 time: 0.0447311 May 20 20:45:28.325276 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-b783a845-031c-422e-9593-5e5cf483e478 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:28.326720 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-b783a845-031c-422e-9593-5e5cf483e478 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 812 time: 0.1565580 May 20 20:45:28.384191 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-68d0f1e5-7513-4e6d-a59b-eb473424c835 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 380 time: 0.0426848 May 20 20:45:28.398112 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'port': {'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'admin_state_up': True, 'tenant_id': '0fc67707e21b4394989903515082b61d', 'security_groups': ['68fab0cc-a704-4908-b5f6-79379e2689f7']}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:45:28.463754 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-19d1a3d4-3b93-4892-9e23-accc4146c224 req-df5c27c4-065e-49a6-bbc0-a09c2ac38a8c tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 210 time: 0.0599127 May 20 20:45:28.546007 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:45:28.558009 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:45:28.567486 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Made reservation on behalf of 0fc67707e21b4394989903515082b61d for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:45:28.571061 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:28.740199 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Allocated IP 172.20.0.9 (9997745d-f55f-4dcf-a08c-5d192080ee30/5f15ab56-6f84-44c6-ba41-332f6baa9746/a75ba429-37e3-43b6-840e-f1561ae0d109) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:45:28.935889 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:28.950862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Transition to ACTIVE for port object a75ba429-37e3-43b6-840e-f1561ae0d109 will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:45:28.974669 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:28.980892 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-5addd5fc-6e2b-43e1-bd0c-a5f622b1ac83 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:29.163600 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:45:29.167565 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:45:29.171073 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:45:29.215741 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=a75ba429-37e3-43b6-840e-f1561ae0d109,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:29.220682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:29.250503 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:29.251146 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:29.278557 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8842819 May 20 20:45:29.297808 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Request body: {'port': {'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:45:29.418623 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:29.437326 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b1ac36-d5b7-4031-81dc-cf77cefdbb3c None None] Provisioning for port a75ba429-37e3-43b6-840e-f1561ae0d109 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:45:29.442259 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-03b1ac36-d5b7-4031-81dc-cf77cefdbb3c None None] Provisioning complete for port a75ba429-37e3-43b6-840e-f1561ae0d109 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:45:29.442639 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b1ac36-d5b7-4031-81dc-cf77cefdbb3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:29.499337 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b1ac36-d5b7-4031-81dc-cf77cefdbb3c None None] Port a75ba429-37e3-43b6-840e-f1561ae0d109 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:45:29.754686 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0997ea92-6983-452e-a610-219a49897da1 req-f8aa6187-75c8-4e9d-af30-5a4fbd655e0d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:29.755270 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-0997ea92-6983-452e-a610-219a49897da1 req-f8aa6187-75c8-4e9d-af30-5a4fbd655e0d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:45:29.811238 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-0997ea92-6983-452e-a610-219a49897da1 req-f8aa6187-75c8-4e9d-af30-5a4fbd655e0d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:45:29.812391 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0997ea92-6983-452e-a610-219a49897da1 req-f8aa6187-75c8-4e9d-af30-5a4fbd655e0d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 931 time: 0.2266808 May 20 20:45:29.865431 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a75ba429-37e3-43b6-840e-f1561ae0d109 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:45:29.876994 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:29.884712 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0997ea92-6983-452e-a610-219a49897da1 req-9be10412-a5ca-47f9-9b2d-0a15da6be96e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579712 May 20 20:45:29.896361 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Transition to ACTIVE for port object a75ba429-37e3-43b6-840e-f1561ae0d109 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:45:29.900126 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:29.905459 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-db34888e-c983-46ca-bba6-318fdc24a808 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:30.096924 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Pushing event updated for resources: {'Port': ['ID=a75ba429-37e3-43b6-840e-f1561ae0d109,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:30.100356 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:30.150030 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Attempting to bind port a75ba429-37e3-43b6-840e-f1561ae0d109 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:45:30.150722 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Attempting to bind port a75ba429-37e3-43b6-840e-f1561ae0d109 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:45:30.151064 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Attempting to bind port a75ba429-37e3-43b6-840e-f1561ae0d109 on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:45:30.156104 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Port a75ba429-37e3-43b6-840e-f1561ae0d109 on network 9997745d-f55f-4dcf-a08c-5d192080ee30 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:45:30.156326 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Attempting to bind port a75ba429-37e3-43b6-840e-f1561ae0d109 on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:45:30.161371 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 45, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:45:30.161701 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Checking segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:45:30.162079 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Bound using segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:45:30.162505 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Bound port: a75ba429-37e3-43b6-840e-f1561ae0d109, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:45:30.162846 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:30.253032 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] For port a75ba429-37e3-43b6-840e-f1561ae0d109, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:45:30.255866 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] For port a75ba429-37e3-43b6-840e-f1561ae0d109, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=a75ba429-37e3-43b6-840e-f1561ae0d109,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:45:30.260682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:30.265152 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-3f24f213-93c6-454a-a00d-d7a4f35c4dc3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:30.322746 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:30.323364 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:30.324781 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] 10.222.0.69 "PUT /v2.0/ports/a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 1093 time: 1.0321965 May 20 20:45:30.325298 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:45:30.348796 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Pushing event updated for resources: {'Port': ['ID=a75ba429-37e3-43b6-840e-f1561ae0d109,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:30.352111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:30.405408 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'status': 'completed', 'code': 200} May 20 20:45:30.443701 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-961ae6ce-38fc-4782-839f-6f49b9d1319b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:30.445218 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-961ae6ce-38fc-4782-839f-6f49b9d1319b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1096 time: 0.0772536 May 20 20:45:30.527194 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-cb686610-8474-4750-8379-2be8635241d8 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 217 time: 0.0665503 May 20 20:45:30.597170 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-f93a7aff-0937-4904-a266-23b9b88427e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:30.598479 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-f93a7aff-0937-4904-a266-23b9b88427e3 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0604179 May 20 20:45:30.680107 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c118af-592c-4262-9269-9e1f7665d981 req-ceae9889-f2bd-4fb3-b57b-9df3116479a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:30.681547 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-ceae9889-f2bd-4fb3-b57b-9df3116479a0 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0702093 May 20 20:45:30.821204 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-7fa93358-6b9e-468e-b29a-b7b5715b70f2 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267769 May 20 20:45:30.956337 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-97c118af-592c-4262-9269-9e1f7665d981 req-107dd08b-2043-4146-ac3a-bbfae969c2a0 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259122 May 20 20:45:31.227731 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01470d2b-aeb3-4e83-8ba4-0644104fdf65 req-143a0eac-ef68-46bd-a1f7-96ed482f0162 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:31.229929 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-01470d2b-aeb3-4e83-8ba4-0644104fdf65 req-143a0eac-ef68-46bd-a1f7-96ed482f0162 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 943 time: 0.2376959 May 20 20:45:31.232768 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f5d901-c997-411c-adae-c6d59f24e691 req-61202f6e-00a1-485b-959e-bda7f1afbe44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:31.234109 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37f5d901-c997-411c-adae-c6d59f24e691 req-61202f6e-00a1-485b-959e-bda7f1afbe44 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1096 time: 0.1086619 May 20 20:45:31.360340 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-01470d2b-aeb3-4e83-8ba4-0644104fdf65 req-63565a90-4000-4ec3-bd87-846b172d239a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1247621 May 20 20:45:31.397488 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f5d901-c997-411c-adae-c6d59f24e691 req-3cc06751-920b-4ff0-bf20-aeb7b6e76004 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:31.398902 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37f5d901-c997-411c-adae-c6d59f24e691 req-3cc06751-920b-4ff0-bf20-aeb7b6e76004 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1499164 May 20 20:45:31.471413 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37f5d901-c997-411c-adae-c6d59f24e691 req-075840e4-2c66-43af-b2e6-751a1a9ba55c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 217 time: 0.0591640 May 20 20:45:31.543002 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f5d901-c997-411c-adae-c6d59f24e691 req-52c094bd-ee4c-4235-9b9c-88f42b552239 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:31.544714 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37f5d901-c997-411c-adae-c6d59f24e691 req-52c094bd-ee4c-4235-9b9c-88f42b552239 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0609894 May 20 20:45:31.625520 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f5d901-c997-411c-adae-c6d59f24e691 req-3db36f2d-dfbb-49e9-aedc-f8b235925d01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:31.626990 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37f5d901-c997-411c-adae-c6d59f24e691 req-3db36f2d-dfbb-49e9-aedc-f8b235925d01 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0713017 May 20 20:45:31.766954 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37f5d901-c997-411c-adae-c6d59f24e691 req-f6ccddb8-0c8e-4c84-8fc2-030e4d36cee3 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262443 May 20 20:45:31.904687 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-37f5d901-c997-411c-adae-c6d59f24e691 req-aa2e6db7-20ae-47a5-b519-6acaee7d3629 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260374 May 20 20:45:32.545956 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ceaf2a0-189b-49a5-b4f4-ccc190548e7b req-6b17bfe2-846d-4c45-8844-b6af6068e7bb tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:32.547341 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9ceaf2a0-189b-49a5-b4f4-ccc190548e7b req-6b17bfe2-846d-4c45-8844-b6af6068e7bb tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 943 time: 0.0816624 May 20 20:45:32.592548 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-9ceaf2a0-189b-49a5-b4f4-ccc190548e7b req-d4dc8da7-ffeb-4754-addd-41f25361184e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391910 May 20 20:45:33.782049 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a83301-f2c4-4d16-a923-f8048e5288f6 req-f81980ac-3d15-475d-9112-da5a1eabd62a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:33.783494 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-29a83301-f2c4-4d16-a923-f8048e5288f6 req-f81980ac-3d15-475d-9112-da5a1eabd62a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 943 time: 0.0834649 May 20 20:45:33.828749 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-29a83301-f2c4-4d16-a923-f8048e5288f6 req-6888cbf5-9d62-4cfe-bd5f-4449a80e8412 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395653 May 20 20:45:34.822302 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-74202da8-bd83-4328-8e58-748e3f8b16a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:35.017495 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a52840-677f-4e16-9e52-be57cf551533 req-c556b90c-879a-4880-a4ba-99bcd8466dc1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:35.018961 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-94a52840-677f-4e16-9e52-be57cf551533 req-c556b90c-879a-4880-a4ba-99bcd8466dc1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 943 time: 0.0840209 May 20 20:45:35.065138 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-94a52840-677f-4e16-9e52-be57cf551533 req-2d5156be-789b-4e40-afee-982c41aaa5d8 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405135 May 20 20:45:36.252880 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae340e7-1310-43a0-ab2a-2c8f70ac841a req-1341beda-400f-40d7-9877-cc4db0711fcd tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:36.254324 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2ae340e7-1310-43a0-ab2a-2c8f70ac841a req-1341beda-400f-40d7-9877-cc4db0711fcd tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 943 time: 0.0815058 May 20 20:45:36.302846 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-2ae340e7-1310-43a0-ab2a-2c8f70ac841a req-1cadf790-ce77-4503-8e1a-37024c4c539d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428176 May 20 20:45:37.244462 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:37.486710 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5268a3bc-3231-40c9-a157-b1ff386a7ca2 req-9c08012b-6ad9-4621-abc4-edb294ee3753 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:37.488075 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5268a3bc-3231-40c9-a157-b1ff386a7ca2 req-9c08012b-6ad9-4621-abc4-edb294ee3753 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 943 time: 0.0801966 May 20 20:45:37.535518 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-d7457642-085f-4d78-9b3f-6bfdbb97dceb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:37.536415 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5268a3bc-3231-40c9-a157-b1ff386a7ca2 req-e7dbd606-4b53-4b02-bf84-1ab9ef60aab1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426295 May 20 20:45:38.363227 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:38.720994 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f315fcb-f49a-4544-8505-73510daed135 req-52a977af-02fd-4a3c-9e23-d145d31f6fa3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:38.722425 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8f315fcb-f49a-4544-8505-73510daed135 req-52a977af-02fd-4a3c-9e23-d145d31f6fa3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 943 time: 0.0788531 May 20 20:45:38.734974 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device a75ba429-37e3-43b6-840e-f1561ae0d109 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:45:38.766455 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-8f315fcb-f49a-4544-8505-73510daed135 req-121aa95a-f1ef-4597-93db-8b28882d78b7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383329 May 20 20:45:38.867274 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port a75ba429-37e3-43b6-840e-f1561ae0d109, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=a75ba429-37e3-43b6-840e-f1561ae0d109,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:45:38.880784 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 830, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:45:38.936112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:38.952995 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a75ba429-37e3-43b6-840e-f1561ae0d109 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:45:38.968032 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port a75ba429-37e3-43b6-840e-f1561ae0d109, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=a75ba429-37e3-43b6-840e-f1561ae0d109,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:45:38.971969 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:38.974897 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-faefcbd7-e129-4ed7-a35d-ab2900bf8052 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:39.040860 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=a75ba429-37e3-43b6-840e-f1561ae0d109,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:39.048438 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.048787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.049127 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.049462 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.049787 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.050112 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.050433 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.050751 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.051070 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.051395 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.051708 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.052050 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:39.055937 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:39.351535 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['a75ba429-37e3-43b6-840e-f1561ae0d109'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:45:39.953571 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59aa695d-5f42-4af2-92e2-8dbf10cb653b req-bb24724b-ab7d-47e4-8215-ef0b696c80ce tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:39.955052 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-59aa695d-5f42-4af2-92e2-8dbf10cb653b req-bb24724b-ab7d-47e4-8215-ef0b696c80ce tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 944 time: 0.0820205 May 20 20:45:39.968784 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:40.000995 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-59aa695d-5f42-4af2-92e2-8dbf10cb653b req-117abd0b-5550-49b1-a936-b12ecdce3675 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401559 May 20 20:45:40.752718 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device a75ba429-37e3-43b6-840e-f1561ae0d109 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:45:40.822638 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port a75ba429-37e3-43b6-840e-f1561ae0d109 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:45:40.827522 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port a75ba429-37e3-43b6-840e-f1561ae0d109 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:45:40.827928 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:40.943493 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:40.971335 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:45:40.981890 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port a75ba429-37e3-43b6-840e-f1561ae0d109, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=a75ba429-37e3-43b6-840e-f1561ae0d109,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:45:40.986070 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:40.988093 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-21fae39e-867d-49f4-af2b-bb5cb99a3f89 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:41.061495 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=a75ba429-37e3-43b6-840e-f1561ae0d109,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:41.064750 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:41.079196 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'code': 200} May 20 20:45:41.211831 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5253f564-f49a-46cc-b95a-0b3685bdf3fe req-c70cf701-4b29-4ce2-bfb3-c4f2811a1720 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:41.213817 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5253f564-f49a-46cc-b95a-0b3685bdf3fe req-c70cf701-4b29-4ce2-bfb3-c4f2811a1720 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 945 time: 0.0828736 May 20 20:45:41.259339 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-5253f564-f49a-46cc-b95a-0b3685bdf3fe req-4bcf9fd5-978e-44f8-b18d-0428baea0e86 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393636 May 20 20:45:41.431132 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ac01253-b405-484a-9a9f-b03a75ce36e7 req-a9c69bf0-d09b-406f-987a-409b53c9d0b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:41.432902 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6ac01253-b405-484a-9a9f-b03a75ce36e7 req-a9c69bf0-d09b-406f-987a-409b53c9d0b6 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1098 time: 0.0758364 May 20 20:45:41.477612 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6ac01253-b405-484a-9a9f-b03a75ce36e7 req-96e990e8-2e4e-4c8d-bdac-887bcbae55f6 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345883 May 20 20:45:42.447584 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398edc3a-80a1-4341-a0ff-52e8cbcd7270 req-455cab62-de1c-4ff2-909f-b8bbfd1b1c1e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:42.448956 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-398edc3a-80a1-4341-a0ff-52e8cbcd7270 req-455cab62-de1c-4ff2-909f-b8bbfd1b1c1e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 945 time: 0.0806110 May 20 20:45:42.492989 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-398edc3a-80a1-4341-a0ff-52e8cbcd7270 req-171306b1-92c5-48ee-8405-5bc7abb524a1 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382342 May 20 20:45:43.677303 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04a0b8e-ab46-40dc-a914-623cc26fe95a req-4dadc960-c030-43ea-b580-541bf24d7c5d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:43.678780 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d04a0b8e-ab46-40dc-a914-623cc26fe95a req-4dadc960-c030-43ea-b580-541bf24d7c5d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 945 time: 0.0801077 May 20 20:45:43.723710 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d04a0b8e-ab46-40dc-a914-623cc26fe95a req-bd75f770-9498-470e-82d8-902a4e024a47 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391290 May 20 20:45:43.907853 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e3ecf5-f8db-4c25-b7b0-77984a4ca29d req-c21aaed5-25df-44ca-9bb9-bcd94bfef60f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:43.909286 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f3e3ecf5-f8db-4c25-b7b0-77984a4ca29d req-c21aaed5-25df-44ca-9bb9-bcd94bfef60f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 945 time: 0.0814757 May 20 20:45:43.954082 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f3e3ecf5-f8db-4c25-b7b0-77984a4ca29d req-5870cc82-3c42-4ed0-b7fc-afbc56f88163 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391178 May 20 20:45:43.978140 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47592) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:45:44.053578 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dfa1b4c-952f-42bb-8137-558d210949ff tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:44.055072 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-4dfa1b4c-952f-42bb-8137-558d210949ff tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1093 time: 0.0759673 May 20 20:45:44.057859 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47596) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:45:44.064689 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.v2.base [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address': '172.20.0.9'}} {{(pid=91645) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:45:44.070658 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:45:44.076778 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:floatingip and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:45:44.080089 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.quota.resource [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=91645) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:45:44.085760 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.quota.driver [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=91645) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:45:44.096287 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:44.236987 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:44.470608 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.db_base_plugin_common [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Allocated IP 172.27.3.201 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/d07da8b7-8ed3-4530-8c7b-c97d86ebfe73) {{(pid=91645) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:45:44.617257 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:44.646307 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3178405'] for port, after_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:44.650729 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:44.709388 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91645) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:45:44.712197 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.base_scheduler [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources bound (agent type, host, resource id): {{(pid=91645) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:45:44.715751 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Received port after_create {{(pid=91645) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:45:44.752828 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=d07da8b7-8ed3-4530-8c7b-c97d86ebfe73,revision_number=1']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:44.768558 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.768935 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.769301 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.769661 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.770015 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.770369 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.770720 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.771071 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.771419 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.771793 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.772137 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.772480 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:45:44.777758 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:45.141885 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:45.190933 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:45.217177 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:45.423449 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:45.427784 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3178412'] for port, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:45.432152 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-24868f02-0e9e-4523-be2c-cf5968bee2c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:45:45.538246 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=d07da8b7-8ed3-4530-8c7b-c97d86ebfe73,revision_number=2']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:45:45.542209 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:45:45.546121 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:45.717633 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.db.l3_db [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Floating IP f68aabf2-74d3-4445-8a3d-cce3f0f926d5 associated. External IP: 172.27.3.201, port: a75ba429-37e3-43b6-840e-f1561ae0d109. May 20 20:45:46.167251 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91645) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:45:46.346332 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91645) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:45:46.356288 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:45:46.365463 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:45:46.366096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:45:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:46.371021 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:45:46.430675 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-b1a397c7-4a74-4e1b-9081-139002f9876e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3712299 May 20 20:45:46.431239 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109'}] {{(pid=91645) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:45:46.475936 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'status': 'completed', 'code': 200} May 20 20:45:46.561479 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:45:46.581649 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-6453ff8d-ba25-4fea-87b4-f9ebed31456d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:46.583143 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-6453ff8d-ba25-4fea-87b4-f9ebed31456d service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1098 time: 0.0720806 May 20 20:45:46.725969 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-e5ea124a-b50c-4aab-97b6-5fa4c79cd2d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:46.727367 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-e5ea124a-b50c-4aab-97b6-5fa4c79cd2d0 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1307650 May 20 20:45:46.910395 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:45Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:46.914220 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:45:46.924367 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:45:46.924980 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:45:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:46.927634 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-9fdbfbc8-225c-4fa3-9f9f-4460396e8c21 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 999 time: 0.1876070 May 20 20:45:46.999859 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-e440ac49-c1e2-4689-828b-8830e7963f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:47.001206 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-e440ac49-c1e2-4689-828b-8830e7963f5f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0611649 May 20 20:45:47.082533 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-c311e60d-5f5a-4948-87d8-49793cfcc74a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:45:47.084031 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-c311e60d-5f5a-4948-87d8-49793cfcc74a service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0714457 May 20 20:45:47.100031 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:45:47.226234 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-8933376d-0948-4748-b6bc-0644a893b9b6 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269777 May 20 20:45:47.361748 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f791a8e6-d072-4988-8c3d-c89f8d7aff0d req-a9b6e459-8d8b-4c26-89d7-6c4380ca8c99 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1267865 May 20 20:45:47.481431 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:45Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:45:47.485477 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-517704f2-a19c-40b7-adc8-5dd595c39196 None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:45Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:45:47.651554 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db01aec6-c5bc-4747-a59b-ee697d109767 None None] New status for floating IP f68aabf2-74d3-4445-8a3d-cce3f0f926d5: ACTIVE {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:45:55.798818 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:46:04.824767 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-acef09fe-55ee-4b11-b9e8-840ddd05646e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:07.097823 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [req-d676f341-6758-45d1-8c6a-07a89cf56e13 req-39f22d47-f465-44b6-99a8-24a600332107 service neutron] (91646) timed out ('10.222.0.82', 40816) {{(pid=91646) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 20 20:46:07.247669 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:07.537958 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-06ce999e-b09c-419d-8d10-891d93032bff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:08.366126 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:09.971366 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:15.216748 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:22.302591 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-be5076fe-607b-4249-9ed2-33a51fa3c2c6 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0760224 May 20 20:46:22.449408 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-0fd787ad-172b-44c8-9231-369a0cb76976 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:46:22.450766 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-0fd787ad-172b-44c8-9231-369a0cb76976 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1098 time: 0.0719039 May 20 20:46:22.601430 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-ac4275c7-6272-499d-938d-dac41c9129d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:46:22.602862 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-ac4275c7-6272-499d-938d-dac41c9129d7 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1249478 May 20 20:46:22.710887 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-61a4a850-5425-45bc-bf6e-8814aefe138b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 1001 time: 0.0958517 May 20 20:46:22.776860 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-1df917c2-b38d-42fc-aff9-3c12839882db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:46:22.778249 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-1df917c2-b38d-42fc-aff9-3c12839882db service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0560951 May 20 20:46:22.860536 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-00e753ac-1150-4176-a9e1-35c8ea6bf268 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:46:22.861985 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-00e753ac-1150-4176-a9e1-35c8ea6bf268 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0719099 May 20 20:46:22.997602 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-dcc178b3-962c-484b-ab4b-cfd3bd1c11a6 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1231349 May 20 20:46:23.131588 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9e0740aa-19b2-4c9e-ba2f-4a558a0d49b3 req-2e546808-be9d-4ecc-ba7b-7f516fdb788f service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1227365 May 20 20:46:32.798558 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:46:34.827936 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9ebc9a12-60e3-4055-99b0-01cc1d5bb467 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:37.249695 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:37.544813 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-ea463cf7-ed99-47d3-beef-13377cd24c2c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:38.368371 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:39.973895 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:46:45.205096 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:04.830827 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8acc9d2a-1cfc-467f-a11c-df9979a6047d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:07.252007 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:07.547390 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49aa1ab0-047a-40a9-8a49-25d8295937d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:08.374259 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:09.798013 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:47:09.983253 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:15.218376 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:24.289135 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-9cb88bd6-c73b-47c3-b6b3-fa1373f21154 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0672827 May 20 20:47:24.442905 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-ce09d7df-494f-482b-8f14-1f43294c2d26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:47:24.444430 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-ce09d7df-494f-482b-8f14-1f43294c2d26 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1098 time: 0.0731449 May 20 20:47:24.691015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-6f74f9c6-bf89-4094-92a6-834344c855fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:47:24.692467 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-6f74f9c6-bf89-4094-92a6-834344c855fc service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.2224941 May 20 20:47:24.802473 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-6838eec4-5fc1-4d08-9a07-392b3a2e0ab4 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 1001 time: 0.0976560 May 20 20:47:24.870037 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-373ee2b7-573f-4841-93d7-053121bda982 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:47:24.871480 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-373ee2b7-573f-4841-93d7-053121bda982 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0578918 May 20 20:47:24.950481 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-3190dd38-28ba-4ded-8fdb-fe7414c788c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:47:24.952660 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-3190dd38-28ba-4ded-8fdb-fe7414c788c6 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0699356 May 20 20:47:25.089406 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-3f17f700-ae6c-4015-9164-e49d963fa48b service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237731 May 20 20:47:25.226653 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-057b08ff-dc3f-4ede-8e62-bb3044bce430 req-bc6493be-27c6-4f34-9732-611541c2e7a1 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1245449 May 20 20:47:34.833238 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-418a7085-5808-4d3e-bc6a-3a0a190c638e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:37.254561 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:37.549992 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-558d1b7a-aeb3-4e7c-b268-ea353c1159c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:38.375661 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:39.976760 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:45.234482 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:47:46.796896 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:48:03.685708 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-d078db74-66b1-4876-b076-0231d6672044 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1294408510&fields=id&tenant_id=0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 267 time: 0.0426972 May 20 20:48:03.837134 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-e2634896-6a72-442d-a89b-a3e5047dbab8 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:03.838429 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-e2634896-6a72-442d-a89b-a3e5047dbab8 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 812 time: 0.1455462 May 20 20:48:03.853706 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-ba6b9954-ca03-4526-aa1a-49a2cfe5ceba tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/quotas/0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 375 time: 0.0091746 May 20 20:48:03.943010 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-a6feeaba-25ee-4d07-a834-7c9b03c1820b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0841987 May 20 20:48:04.118655 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-0a60bf6b-35b1-4ce0-8af0-5977b3db006b service neutron] 10.222.0.82 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1643939 May 20 20:48:04.253296 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-8ea14643-9bc3-40bd-9074-b45dec2e2b56 service neutron] 10.222.0.82 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1287372 May 20 20:48:04.687823 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-f8d0ba67-f5ff-438b-97a1-aa7bf4a9e007 req-2a25f50b-dde5-4413-9389-2abf497ebe27 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 210 time: 0.0925536 May 20 20:48:04.836056 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a992484f-a138-4b04-b534-c1d8376fb90b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:05.788179 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-55d1064d-89dc-4890-b911-bcd3992408a5 req-443c7e20-ecb4-45e3-b3df-c8345fec77c7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 210 time: 0.0475235 May 20 20:48:06.949640 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-cdada1ac-1d04-43b1-a1b3-2f38d7f5294d req-d58b1de3-4c68-4bcb-aff7-cd8f2ac74da8 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 210 time: 0.0426884 May 20 20:48:07.258616 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:07.553608 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c4571611-7df9-41e8-ab73-83bb1a17f469 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:07.868869 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-5388d988-130d-4ae3-9d9b-5d47f7962250 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:07.870272 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-5388d988-130d-4ae3-9d9b-5d47f7962250 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 812 time: 0.1590207 May 20 20:48:07.921369 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-3411f266-4504-4656-ab51-914f993a67ab tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0fc67707e21b4394989903515082b61d HTTP/1.1" status: 200 len: 380 time: 0.0407674 May 20 20:48:07.931070 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'port': {'device_id': '3c030218-932a-493f-8bc8-5150f880752a', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'admin_state_up': True, 'tenant_id': '0fc67707e21b4394989903515082b61d', 'security_groups': ['68fab0cc-a704-4908-b5f6-79379e2689f7']}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:48:08.107185 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-38f953a5-3b31-4118-8ea1-daaa01007d21 req-e6eb8b2f-e5b0-49dc-88c8-ef2a580481ef tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 210 time: 0.0470262 May 20 20:48:08.107976 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:48:08.117734 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:48:08.128977 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Made reservation on behalf of 0fc67707e21b4394989903515082b61d for: {'port': 1} {{(pid=91646) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 20 20:48:08.132873 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:08.380086 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:08.398119 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Allocated IP 172.20.0.8 (9997745d-f55f-4dcf-a08c-5d192080ee30/5f15ab56-6f84-44c6-ba41-332f6baa9746/f08a96b6-1468-4818-b7dd-1d27381138b0) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:48:08.587738 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:08.604032 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Transition to ACTIVE for port object f08a96b6-1468-4818-b7dd-1d27381138b0 will not be triggered until provisioned by entity DHCP. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:48:08.628129 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:08.633870 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0eabd800-6760-4be9-8961-39c20bd32a6e tempest-VolumesNegativeTest-761773359 tempest-VolumesNegativeTest-761773359-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:48:08.702627 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:48:08.705797 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:48:08.709627 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:48:08.744702 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=f08a96b6-1468-4818-b7dd-1d27381138b0,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:48:08.762115 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.762486 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.762847 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.763202 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.763554 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.763931 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.764277 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.764629 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.764974 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.765315 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.765653 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.766204 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:08.771891 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:48:08.787570 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:08.788223 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:08.815794 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-cfb525fb-2cf4-4847-ab8d-79de4f65ede2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8885140 May 20 20:48:08.828244 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-72283f92-5845-4a4d-8cf4-0061b80cb24a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=91646) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 20 20:48:08.829228 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-72283f92-5845-4a4d-8cf4-0061b80cb24a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0055330 May 20 20:48:08.842316 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Request body: {'port': {'device_id': '3c030218-932a-493f-8bc8-5150f880752a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78462'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:48:08.957389 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:08.965716 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-0e0382f9-b777-4cd9-a1f4-bbee82ccef76 None None] Provisioning for port f08a96b6-1468-4818-b7dd-1d27381138b0 completed by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:48:08.970250 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-0e0382f9-b777-4cd9-a1f4-bbee82ccef76 None None] Provisioning complete for port f08a96b6-1468-4818-b7dd-1d27381138b0 triggered by entity DHCP. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:48:08.970620 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0e0382f9-b777-4cd9-a1f4-bbee82ccef76 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:09.025477 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-0e0382f9-b777-4cd9-a1f4-bbee82ccef76 None None] Port f08a96b6-1468-4818-b7dd-1d27381138b0 cannot update to ACTIVE because it is not bound. {{(pid=91647) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 20 20:48:09.294849 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f08a96b6-1468-4818-b7dd-1d27381138b0 {{(pid=91646) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:48:09.298315 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b60c503-0b29-4371-b6ea-a815f55f5c72 req-e064c067-2c9d-4451-8e3f-35c4118dac01 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:09.299829 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6b60c503-0b29-4371-b6ea-a815f55f5c72 req-e064c067-2c9d-4451-8e3f-35c4118dac01 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 931 time: 0.0871434 May 20 20:48:09.302670 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:09.317257 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.provisioning_blocks [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Transition to ACTIVE for port object f08a96b6-1468-4818-b7dd-1d27381138b0 will not be triggered until provisioned by entity L2. {{(pid=91646) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 20 20:48:09.321186 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:09.324744 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b99d37a5-4ab7-4c10-8d41-150d74865810 tempest-AttachVolumeShelveTestJSON-757656886 tempest-AttachVolumeShelveTestJSON-757656886-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:48:09.347442 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-6b60c503-0b29-4371-b6ea-a815f55f5c72 req-5361f31c-a920-4889-8b3b-35a3d8e68bbb tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416389 May 20 20:48:09.481491 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Pushing event updated for resources: {'Port': ['ID=f08a96b6-1468-4818-b7dd-1d27381138b0,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:48:09.488916 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:48:09.564411 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Attempting to bind port f08a96b6-1468-4818-b7dd-1d27381138b0 on host hv-cinder-78462 for vnic_type normal with profile {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 20 20:48:09.564748 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Attempting to bind port f08a96b6-1468-4818-b7dd-1d27381138b0 by drivers openvswitch,hyperv on host hv-cinder-78462 at level 0 using segments [{'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 20 20:48:09.565071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Attempting to bind port f08a96b6-1468-4818-b7dd-1d27381138b0 on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:48:09.569534 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Port f08a96b6-1468-4818-b7dd-1d27381138b0 on network 9997745d-f55f-4dcf-a08c-5d192080ee30 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78462 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 20 20:48:09.569937 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Attempting to bind port f08a96b6-1468-4818-b7dd-1d27381138b0 on network 9997745d-f55f-4dcf-a08c-5d192080ee30 {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 20 20:48:09.575139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Checking agent: {'id': '0dcc06e4-aeb4-4ddc-b91a-598e52d505ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78462', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'started_at': datetime.datetime(2021, 5, 20, 20, 25, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 20, 47, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 20 20:48:09.575470 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Checking segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91646) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 20 20:48:09.575884 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Bound using segment: {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'} {{(pid=91646) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 20 20:48:09.576302 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.managers [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Bound port: f08a96b6-1468-4818-b7dd-1d27381138b0, host: hv-cinder-78462, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '32ff4298-05a9-47bb-9b1a-5c7862ae42f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 830, 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30'}}] {{(pid=91646) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 20 20:48:09.576640 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:09.668921 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] For port f08a96b6-1468-4818-b7dd-1d27381138b0, host hv-cinder-78462, cleared binding levels {{(pid=91646) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 20 20:48:09.672137 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] For port f08a96b6-1468-4818-b7dd-1d27381138b0, host hv-cinder-78462, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f08a96b6-1468-4818-b7dd-1d27381138b0,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 20 20:48:09.676775 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:09.680416 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9513f7a8-bc95-4214-a084-85096492edbc service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:48:09.737534 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:09.738168 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:09.739553 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] 10.222.0.69 "PUT /v2.0/ports/f08a96b6-1468-4818-b7dd-1d27381138b0 HTTP/1.1" status: 200 len: 1093 time: 0.9014325 May 20 20:48:09.740096 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:48:09.760619 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Pushing event updated for resources: {'Port': ['ID=f08a96b6-1468-4818-b7dd-1d27381138b0,revision_number=3']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:48:09.764946 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:48:09.826308 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'status': 'completed', 'code': 200} May 20 20:48:09.869341 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-74f652f3-5847-4bff-855f-8e2e43610df4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:09.870872 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-74f652f3-5847-4bff-855f-8e2e43610df4 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 1096 time: 0.0801599 May 20 20:48:09.944083 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-f08ad029-a7a8-43de-b97c-39bb0536be5c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f08a96b6-1468-4818-b7dd-1d27381138b0 HTTP/1.1" status: 200 len: 217 time: 0.0600505 May 20 20:48:09.988678 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:10.015663 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-a3b05e10-5b91-42bc-9f8f-0ff4e4661846 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:10.017173 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-a3b05e10-5b91-42bc-9f8f-0ff4e4661846 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0623803 May 20 20:48:10.097637 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f928f6-479b-409c-96fd-84803643885b req-4ba25c5d-dde0-4efb-a3fd-eb4154e4638d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:10.099087 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-4ba25c5d-dde0-4efb-a3fd-eb4154e4638d service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0705218 May 20 20:48:10.237322 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-17eab7db-6cab-4016-8a3c-e9b8b49e791f service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1243877 May 20 20:48:10.472141 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d7f928f6-479b-409c-96fd-84803643885b req-81fd5485-e483-42bf-b8b0-3e3f30c21056 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2219868 May 20 20:48:10.537874 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a149450-91e9-4cbb-b6eb-07bddbbb6bf8 req-083798ea-3417-4073-933e-95c10aa029ed tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:10.540198 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0a149450-91e9-4cbb-b6eb-07bddbbb6bf8 req-083798ea-3417-4073-933e-95c10aa029ed tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.0848992 May 20 20:48:10.587389 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-0a149450-91e9-4cbb-b6eb-07bddbbb6bf8 req-95138635-7017-478e-b7ae-aca085543c19 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420585 May 20 20:48:10.599886 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-43922309-bc19-4bf6-805e-5f42338472b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:10.601356 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-43922309-bc19-4bf6-805e-5f42338472b9 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 1096 time: 0.0776403 May 20 20:48:10.737248 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-05ef03ad-e536-42fb-9841-785180205c4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:10.738683 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-05ef03ad-e536-42fb-9841-785180205c4d service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1265056 May 20 20:48:10.812176 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-4e1adf23-faae-4992-9a6d-4564719aa553 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f08a96b6-1468-4818-b7dd-1d27381138b0 HTTP/1.1" status: 200 len: 217 time: 0.0633626 May 20 20:48:10.880041 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-4ee19549-84de-4d6a-a33f-fd62701d4988 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:10.881443 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-4ee19549-84de-4d6a-a33f-fd62701d4988 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0584104 May 20 20:48:10.961495 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-a7f95d25-921c-431f-84ff-7ec299acc7b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:10.962938 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-a7f95d25-921c-431f-84ff-7ec299acc7b3 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0703709 May 20 20:48:11.097535 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-7ec2f6ed-952b-4624-8c42-2adbe3bf2cc2 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235092 May 20 20:48:11.243130 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-4f89cd50-29c6-4fa5-b142-64f4df8d7085 req-7d3f1e69-e49a-4bc8-acd7-a92602f34cd3 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1283407 May 20 20:48:11.777148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c1c4a09-cdaa-491a-a730-be1a4577a5c4 req-aabec93b-7424-451e-8649-b1e3c0c370e7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:11.777831 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-1c1c4a09-cdaa-491a-a730-be1a4577a5c4 req-aabec93b-7424-451e-8649-b1e3c0c370e7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:48:11.793163 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-1c1c4a09-cdaa-491a-a730-be1a4577a5c4 req-aabec93b-7424-451e-8649-b1e3c0c370e7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:48:11.794738 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1c1c4a09-cdaa-491a-a730-be1a4577a5c4 req-aabec93b-7424-451e-8649-b1e3c0c370e7 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.1007700 May 20 20:48:11.839651 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-1c1c4a09-cdaa-491a-a730-be1a4577a5c4 req-77ff964a-45f3-47ac-8c15-f5d19d682c0f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384753 May 20 20:48:13.026005 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72580d8d-ac86-4cfb-95ae-c57dae995f05 req-24adc1c7-956b-4da5-a5fe-3e72de932d2d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:13.027412 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-72580d8d-ac86-4cfb-95ae-c57dae995f05 req-24adc1c7-956b-4da5-a5fe-3e72de932d2d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.0789833 May 20 20:48:13.072216 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-72580d8d-ac86-4cfb-95ae-c57dae995f05 req-a03f33c4-af15-42a9-b82c-1ba3ba43a17f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385063 May 20 20:48:14.261383 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2096d6-3ca1-4439-9818-f539ea3caec8 req-4c686b84-bc3b-4917-a207-6052be211005 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:14.262823 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0f2096d6-3ca1-4439-9818-f539ea3caec8 req-4c686b84-bc3b-4917-a207-6052be211005 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.0823009 May 20 20:48:14.310528 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0f2096d6-3ca1-4439-9818-f539ea3caec8 req-9db0dbba-fa60-4fc3-99ae-612c8f710ab5 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415707 May 20 20:48:15.236274 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:15.497098 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9391bf7-addc-42f3-982f-777736ddcb6f req-b914a109-c510-44c9-9e61-10ecab162142 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:15.498424 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d9391bf7-addc-42f3-982f-777736ddcb6f req-b914a109-c510-44c9-9e61-10ecab162142 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.0817003 May 20 20:48:15.543416 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-d9391bf7-addc-42f3-982f-777736ddcb6f req-89393025-631a-4d9f-8d52-9dd0b44deeb4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384841 May 20 20:48:16.731231 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6049850e-ab5b-4554-bf67-3e9db1b359e0 req-57e5b2b1-5bda-4fa4-a3bd-14ccaf5976a3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:16.732707 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6049850e-ab5b-4554-bf67-3e9db1b359e0 req-57e5b2b1-5bda-4fa4-a3bd-14ccaf5976a3 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.0798779 May 20 20:48:16.778296 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-6049850e-ab5b-4554-bf67-3e9db1b359e0 req-8364d6f6-35c3-4d98-92c9-abbce406706a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393999 May 20 20:48:17.959528 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd52e53-2402-4a1a-9390-f58d089cbd0f req-2a5f4acf-841a-44e0-962b-4dafd31e0c9b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:17.960910 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ffd52e53-2402-4a1a-9390-f58d089cbd0f req-2a5f4acf-841a-44e0-962b-4dafd31e0c9b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.0780611 May 20 20:48:18.010084 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-ffd52e53-2402-4a1a-9390-f58d089cbd0f req-2c35bd45-2dc5-4407-89ad-c157fe468b9b tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434880 May 20 20:48:19.196042 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f679d443-0fe9-49d2-9a13-80cd92649431 req-15b33329-a642-4b51-b4a9-8f4d7188de01 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:19.197968 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f679d443-0fe9-49d2-9a13-80cd92649431 req-15b33329-a642-4b51-b4a9-8f4d7188de01 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 943 time: 0.0835745 May 20 20:48:19.243373 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-f679d443-0fe9-49d2-9a13-80cd92649431 req-5308171c-6dcb-4c96-8722-69b365af5be2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386343 May 20 20:48:19.499699 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f08a96b6-1468-4818-b7dd-1d27381138b0 details requested by agent hyperv_hv-cinder-78462 with host hv-cinder-78462 {{(pid=91647) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 20 20:48:19.630830 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port f08a96b6-1468-4818-b7dd-1d27381138b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f08a96b6-1468-4818-b7dd-1d27381138b0,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:48:19.643581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Returning: {'device': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'port_id': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'mac_address': 'fa:16:3e:06:4b:04', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 830, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91647) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 20 20:48:19.698586 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:19.715055 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f08a96b6-1468-4818-b7dd-1d27381138b0 {{(pid=91647) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 20 20:48:19.730449 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port f08a96b6-1468-4818-b7dd-1d27381138b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f08a96b6-1468-4818-b7dd-1d27381138b0,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:48:19.734614 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:19.738187 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:48:19.807985 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=f08a96b6-1468-4818-b7dd-1d27381138b0,revision_number=4']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:48:19.815087 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.815433 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.815789 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.816122 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.816447 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.816771 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.817091 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.817410 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.817727 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.818043 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.818358 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.818673 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:48:19.822484 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:48:20.111344 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] get_ports_and_sgs() called for port_ids ['f08a96b6-1468-4818-b7dd-1d27381138b0'] {{(pid=91647) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 20 20:48:20.431679 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c6a0fd-61f9-4be3-bfcc-0fb050a3cf23 req-9663ba37-c9d7-4a1b-bfb4-1598ed671641 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:20.433153 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-88c6a0fd-61f9-4be3-bfcc-0fb050a3cf23 req-9663ba37-c9d7-4a1b-bfb4-1598ed671641 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 944 time: 0.0806456 May 20 20:48:20.477942 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-88c6a0fd-61f9-4be3-bfcc-0fb050a3cf23 req-52d193c5-f7b3-48c2-bd30-98bf6625ced9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389018 May 20 20:48:21.517648 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f08a96b6-1468-4818-b7dd-1d27381138b0 up at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 20 20:48:21.589551 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning for port f08a96b6-1468-4818-b7dd-1d27381138b0 completed by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 20 20:48:21.594094 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.provisioning_blocks [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Provisioning complete for port f08a96b6-1468-4818-b7dd-1d27381138b0 triggered by entity L2. {{(pid=91647) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 20 20:48:21.594997 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16074405'] for port, provisioning_complete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:21.678557 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c882ec-2f7d-456e-b64f-ad4ff3134289 req-445d4e34-cb8b-4598-997b-2000daa93109 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:21.680032 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-94c882ec-2f7d-456e-b64f-ad4ff3134289 req-445d4e34-cb8b-4598-997b-2000daa93109 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 944 time: 0.0853879 May 20 20:48:21.711611 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:21.736001 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-94c882ec-2f7d-456e-b64f-ad4ff3134289 req-b0430841-9279-43fe-86e0-aca711330839 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493762 May 20 20:48:21.742519 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0'}] {{(pid=91647) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:48:21.761982 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] For port f08a96b6-1468-4818-b7dd-1d27381138b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f08a96b6-1468-4818-b7dd-1d27381138b0,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:48:21.766210 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450'] for port, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:21.768727 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:48:21.798890 dv-cinder-784623-13-iscsi neutron-server[91647]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'code': 200} May 20 20:48:21.838459 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Pushing event updated for resources: {'Port': ['ID=f08a96b6-1468-4818-b7dd-1d27381138b0,revision_number=5']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:48:21.841410 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:48:22.144777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-635658a4-2030-4615-b990-98cee6bf9dd8 req-5f20179b-c630-4e0c-af99-010354aeb7ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:22.146241 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-635658a4-2030-4615-b990-98cee6bf9dd8 req-5f20179b-c630-4e0c-af99-010354aeb7ae service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 1098 time: 0.1196179 May 20 20:48:22.190508 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-635658a4-2030-4615-b990-98cee6bf9dd8 req-ba5adbd2-545c-4f5d-873a-f0cbd00f88e9 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364788 May 20 20:48:22.920030 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96e4731-a2fb-426e-9f52-b64eb4827545 req-4cd1cbb1-bd97-44de-87d9-05bffaf2c688 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:22.921465 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e96e4731-a2fb-426e-9f52-b64eb4827545 req-4cd1cbb1-bd97-44de-87d9-05bffaf2c688 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 945 time: 0.0791688 May 20 20:48:22.969126 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-e96e4731-a2fb-426e-9f52-b64eb4827545 req-36f27669-60e8-4cac-91e2-39e0fd074183 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408216 May 20 20:48:23.795908 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:48:24.160881 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b57ac3a-ae30-43d9-9fa6-5b2933f19201 req-68f0cfcb-a61c-4b18-8c58-12925623a752 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:24.162383 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3b57ac3a-ae30-43d9-9fa6-5b2933f19201 req-68f0cfcb-a61c-4b18-8c58-12925623a752 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 945 time: 0.0847254 May 20 20:48:24.206718 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-3b57ac3a-ae30-43d9-9fa6-5b2933f19201 req-3eb4b020-86cf-450c-9108-a1ddd32f8688 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385733 May 20 20:48:24.393158 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec18201d-c634-400a-b545-084c66242256 req-6b76ccf7-c199-481c-8c4e-5f549ec90794 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:24.394599 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ec18201d-c634-400a-b545-084c66242256 req-6b76ccf7-c199-481c-8c4e-5f549ec90794 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 945 time: 0.0825322 May 20 20:48:24.439560 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ec18201d-c634-400a-b545-084c66242256 req-e9200c1e-db55-4de6-a2b4-6e2643ace131 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390520 May 20 20:48:24.462403 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47750) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:48:24.663589 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc1084ef-8f91-4d48-b3ce-15320e0ecaae tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:24.665108 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-bc1084ef-8f91-4d48-b3ce-15320e0ecaae tempest-TestVolumeBootPattern-2137761387 tempest-TestVolumeBootPattern-2137761387-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 1093 time: 0.2017603 May 20 20:48:24.667947 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47756) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:48:24.673676 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.v2.base [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Request body: {'floatingip': {'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'port_id': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address': '172.20.0.8'}} {{(pid=91646) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 20 20:48:24.679421 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 20 20:48:24.683144 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Usage tracker for resource:floatingip and tenant:0fc67707e21b4394989903515082b61d is out of sync, need to count used quota {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 20 20:48:24.685913 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=91646) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 20 20:48:24.692219 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.quota.driver [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=91646) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 20 20:48:24.702388 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:24.835720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:24.965864 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_common [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Allocated IP 172.27.3.182 (86a15d61-a97a-4109-a08b-ca9231f239f9/a41fc833-05a5-4db1-8e8c-fa7fa38d3cea/68f87c3b-5026-481c-b2cb-700df910813e) {{(pid=91646) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 20 20:48:25.108343 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:25.136774 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8742245656387', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:25.140199 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-4facc52d-7150-4758-aa21-d1f02ae99b91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:48:25.205268 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Network 86a15d61-a97a-4109-a08b-ca9231f239f9 is already hosted by enough agents. {{(pid=91646) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 20 20:48:25.208078 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.base_scheduler [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Resources bound (agent type, host, resource id): {{(pid=91646) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 20 20:48:25.211590 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Received port after_create {{(pid=91646) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 20 20:48:25.241057 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=68f87c3b-5026-481c-b2cb-700df910813e,revision_number=1']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:48:25.247810 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:48:25.616192 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:25.691595 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-16469407'] for port, before_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:25.890681 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for port, precommit_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:25.895772 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8742246071224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8742245656405', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8742245656450', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2785398'] for port, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:25.899368 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-febdcf95-19b9-4233-a7dd-b0f4ca56cefa tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:48:26.003742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event updated for resources: {'Port': ['ID=68f87c3b-5026-481c-b2cb-700df910813e,revision_number=2']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:48:26.007787 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:48:26.016470 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-737082'] for floatingip, after_update {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:26.183873 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Floating IP de805989-1947-4bab-8e4b-a1442ea8aad4 associated. External IP: 172.27.3.182, port: f08a96b6-1468-4818-b7dd-1d27381138b0. May 20 20:48:26.501746 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-e7745f46-3cf9-422d-9e74-240074467b1b service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1771078 May 20 20:48:26.728737 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:48:26.741727 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-ba2cd1fb-7a93-4ae2-b3a1-eff2feebe82f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:26.743165 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-ba2cd1fb-7a93-4ae2-b3a1-eff2feebe82f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1098 time: 0.1614349 May 20 20:48:27.019501 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-def4153f-9fb0-4046-b22d-66aa74dfc3c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:27.020940 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-def4153f-9fb0-4046-b22d-66aa74dfc3c0 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.2263172 May 20 20:48:27.021861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:48:27.031812 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:48:27.041670 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:48:27.042283 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:48:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:48:27.121011 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:27.178041 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-569ca4ac-c427-453f-a661-2e39d31796bf service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 1001 time: 0.1488433 May 20 20:48:27.184847 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-e95f8c07-4079-49b1-b80c-02b9ba8a4930 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5157404 May 20 20:48:27.185568 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:48:27.237153 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'status': 'completed', 'code': 200} May 20 20:48:27.263071 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:48:27.267959 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-8b049a75-cd10-4300-8e18-d18160eef0a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:27.269395 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-8b049a75-cd10-4300-8e18-d18160eef0a9 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0727494 May 20 20:48:27.395658 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-fc6cdf1b-9ba0-4939-b755-6c129e5c653e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:27.397141 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-fc6cdf1b-9ba0-4939-b755-6c129e5c653e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0974827 May 20 20:48:27.398974 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-b2a475c2-d0ef-4241-8c66-89582ab6f2cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:27.400299 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-b2a475c2-d0ef-4241-8c66-89582ab6f2cd service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 1098 time: 0.1300945 May 20 20:48:27.612157 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'de805989-1947-4bab-8e4b-a1442ea8aad4', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.182', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:06:4b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c030218-932a-493f-8bc8-5150f880752a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:48:25Z', 'updated_at': '2021-05-20T20:48:25Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}, {'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:47Z', 'revision_number': 1, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:48:27.616603 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:48:27.625392 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:48:27.626792 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:48:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:48:27.767143 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-e40af042-59a4-4d61-918d-542b4b090fe0 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3565602 May 20 20:48:27.769432 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-efc97f3f-c766-40c8-966d-5b71b4725c6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:27.770743 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-efc97f3f-c766-40c8-966d-5b71b4725c6e service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.3591011 May 20 20:48:27.805266 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:48:27.981333 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-55ef88e4-8376-4370-b1c7-5b7ed8eafc03 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f08a96b6-1468-4818-b7dd-1d27381138b0 HTTP/1.1" status: 200 len: 999 time: 0.1700840 May 20 20:48:28.047242 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-973ee6a1-5324-4b1a-9577-7f20ac77a260 req-5525bb44-30d6-4110-8d28-8d313b3f9ef2 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2578974 May 20 20:48:28.066975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-31576684-44d3-4dd1-bbc1-7908a8b870af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:28.068432 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-31576684-44d3-4dd1-bbc1-7908a8b870af service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0705659 May 20 20:48:28.151428 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'de805989-1947-4bab-8e4b-a1442ea8aad4', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.182', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:06:4b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c030218-932a-493f-8bc8-5150f880752a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:48:25Z', 'updated_at': '2021-05-20T20:48:25Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}, {'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:47Z', 'revision_number': 1, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:48:28.152088 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-8ae935f6-fffc-470a-b77d-a9dd0fa6727e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:48:28.153014 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-8ae935f6-fffc-470a-b77d-a9dd0fa6727e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0721483 May 20 20:48:28.155519 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-782b85ae-3c1f-47e6-9bc4-010833b81d06 None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'de805989-1947-4bab-8e4b-a1442ea8aad4', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.182', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:06:4b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c030218-932a-493f-8bc8-5150f880752a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:48:25Z', 'updated_at': '2021-05-20T20:48:25Z', 'revision_number': 0, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}, {'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:47Z', 'revision_number': 1, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:48:28.293773 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-861a2dc7-83cf-4ba0-9d3e-1e62881f6a2b service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1284306 May 20 20:48:28.364137 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9ea2473-b1f8-4b63-8d5b-3a2f8f887b8c None None] New status for floating IP de805989-1947-4bab-8e4b-a1442ea8aad4: ACTIVE {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:48:28.433486 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-c076d37e-329c-4923-b675-ff8a6cc0aa90 req-7cf4a7b8-adff-4718-bf4d-f3152cf292f6 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1321278 May 20 20:48:34.838581 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c93d6d6b-bdef-4090-a4da-12d213c72ff1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:37.261397 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:37.556637 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-b097af38-eedd-4bd0-9f38-b44da620a643 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:38.381875 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:39.983749 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:48:45.239633 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:00.794738 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:49:04.840380 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5814e6fd-cff3-47db-9368-8c8ba52cfb19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:07.262621 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:07.558781 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2f42be81-f28e-4506-a4ce-19d5c8bc1bf5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:08.384959 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:09.994427 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:15.247773 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:26.340224 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-4fde47b2-c595-440c-ae52-40bfe4f5587a service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0729725 May 20 20:49:26.434931 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-9ed8379a-70cd-4e65-9466-c1f7a039709f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:49:26.436414 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-9ed8379a-70cd-4e65-9466-c1f7a039709f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 1098 time: 0.0702627 May 20 20:49:26.584511 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-737e8789-0037-4ba2-8125-f436ab7f56e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:49:26.585866 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-737e8789-0037-4ba2-8125-f436ab7f56e7 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1261020 May 20 20:49:26.693610 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-d835c75c-fb66-450e-9f6a-6765288cdee4 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f08a96b6-1468-4818-b7dd-1d27381138b0 HTTP/1.1" status: 200 len: 1001 time: 0.0958638 May 20 20:49:26.762528 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-afd3745e-3699-41ea-a8ba-50c5d93e1511 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:49:26.763275 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-afd3745e-3699-41ea-a8ba-50c5d93e1511 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0566788 May 20 20:49:26.845273 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-fc00ef10-03aa-4242-b913-3aa66c2525a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:49:26.846618 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-fc00ef10-03aa-4242-b913-3aa66c2525a6 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0716064 May 20 20:49:26.981355 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-cd1ac4d4-20c9-491e-9e47-da573232ac12 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1221626 May 20 20:49:27.209781 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9d5edd91-aac3-4381-89f9-86c9b6ace285 req-b125aebb-f947-4314-a1fe-953ca302c830 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2201262 May 20 20:49:34.843729 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7fd283fa-c95d-4b8b-8641-5bdf57da2071 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:37.263877 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:37.560634 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-50bf9b2f-8f18-4ce6-ac3e-a9993bd4eb45 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:37.794586 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:49:38.389681 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:39.990779 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:49:45.246455 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:04.845897 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-c7510a93-f474-4702-8013-8b98fa6bf8cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:07.269064 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:07.562241 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-252ff2d0-b3ef-4d6a-a8ef-7f06e047a239 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:08.392076 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:09.992882 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:14.793358 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:50:15.253142 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:18.981732 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47792) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:19.242303 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Deleting port 68f87c3b-5026-481c-b2cb-700df910813e {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:19.242533 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:19.359227 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:19.359834 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:19.482378 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Calling delete_port for 68f87c3b-5026-481c-b2cb-700df910813e owned by network:floatingip {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:19.605638 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:19.609885 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-f95c3b71-2662-423c-9bee-9690e6200560 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:19.653717 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event deleted for resources: {'Port': ['ID=68f87c3b-5026-481c-b2cb-700df910813e,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:19.692475 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.692845 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.693211 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.693748 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.694155 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.694602 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.694959 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.695304 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.695653 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.696018 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.696363 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.696702 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91646) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:19.727048 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:19.755726 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:19.756713 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Floating IP de805989-1947-4bab-8e4b-a1442ea8aad4 disassociated (deleted). External IP: 172.27.3.182, port: f08a96b6-1468-4818-b7dd-1d27381138b0. May 20 20:50:20.096542 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:50:20.277069 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:50:20.286620 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:50:20.296630 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:20.297244 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:20.299071 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:20.468426 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "DELETE /v2.0/floatingips/de805989-1947-4bab-8e4b-a1442ea8aad4 HTTP/1.1" status: 204 len: 168 time: 1.4856012 May 20 20:50:20.469092 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:50:20.539335 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:20.572547 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'status': 'completed', 'code': 200} May 20 20:50:20.672123 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-0b773ff4-9d54-496a-8606-d2f6c1796b26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:20.673690 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-0b773ff4-9d54-496a-8606-d2f6c1796b26 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 1098 time: 0.0753534 May 20 20:50:20.819449 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-48ce40dd-a217-4427-ad5f-faaf1a506d37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:20.820972 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-48ce40dd-a217-4427-ad5f-faaf1a506d37 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1278725 May 20 20:50:20.851180 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-667c2b26-03b1-4bc2-98f1-d770fa23f203 req-7f00822a-6c71-47f5-85b4-08c7cdd1767a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:20.852732 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-667c2b26-03b1-4bc2-98f1-d770fa23f203 req-7f00822a-6c71-47f5-85b4-08c7cdd1767a tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 945 time: 0.0852599 May 20 20:50:20.898157 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-f9761a4e-aa36-4259-948a-6917623e414a service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f08a96b6-1468-4818-b7dd-1d27381138b0 HTTP/1.1" status: 200 len: 217 time: 0.0656810 May 20 20:50:20.901257 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-667c2b26-03b1-4bc2-98f1-d770fa23f203 req-23e72f78-caed-4f89-83e5-e340dceb32d4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424500 May 20 20:50:20.908131 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:47Z', 'revision_number': 1, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:20.912668 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:50:20.923585 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:20.923972 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:20.966654 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-1da6e545-9b77-4d61-a05b-2b06446d74be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:20.967661 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-1da6e545-9b77-4d61-a05b-2b06446d74be service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0579355 May 20 20:50:21.050446 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-962a5f19-3ede-4f7b-8814-024508a26cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:21.052028 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-962a5f19-3ede-4f7b-8814-024508a26cbe service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0744410 May 20 20:50:21.099702 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:21.191496 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-2d8d30b6-ee9f-4ca7-8d26-9ae6afff9690 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282890 May 20 20:50:21.325147 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-d92cc898-270c-4b4b-8290-e5852eadd1d1 req-d6da13a1-20b5-4872-9808-3cf7d2427812 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1268854 May 20 20:50:21.441924 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:47Z', 'revision_number': 1, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:21.446481 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-901d6e9a-3ecf-4817-aff6-e6fd7b6f8f5d None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_floatingips': [{'id': 'f68aabf2-74d3-4445-8a3d-cce3f0f926d5', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'floating_ip_address': '172.27.3.201', 'floating_network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'router_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'port_id': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'mac_address': 'fa:16:3e:ac:3f:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T20:45:45Z', 'updated_at': '2021-05-20T20:45:47Z', 'revision_number': 1, 'project_id': '0fc67707e21b4394989903515082b61d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:50:21.643282 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9d006dd-f82a-42bd-b177-ecb1cd2f5d71 None None] New status for floating IP de805989-1947-4bab-8e4b-a1442ea8aad4: DOWN {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:50:22.090385 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff61f6a4-ee73-44f0-a56f-fec5656e7a67 req-dc0d3c38-cb99-40fb-813e-ed7f2e4b8978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:22.090995 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ff61f6a4-ee73-44f0-a56f-fec5656e7a67 req-dc0d3c38-cb99-40fb-813e-ed7f2e4b8978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:50:22.106656 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-ff61f6a4-ee73-44f0-a56f-fec5656e7a67 req-dc0d3c38-cb99-40fb-813e-ed7f2e4b8978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:50:22.107967 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff61f6a4-ee73-44f0-a56f-fec5656e7a67 req-dc0d3c38-cb99-40fb-813e-ed7f2e4b8978 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 945 time: 0.0960975 May 20 20:50:22.153023 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-ff61f6a4-ee73-44f0-a56f-fec5656e7a67 req-d5669828-905a-4ecc-9e2e-a7e314fe2803 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392671 May 20 20:50:22.895156 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-81e892c6-60cb-41d4-afda-decf48bdcb68 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:22.897649 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-81e892c6-60cb-41d4-afda-decf48bdcb68 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 945 time: 0.0989447 May 20 20:50:23.065256 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Deleting port f08a96b6-1468-4818-b7dd-1d27381138b0 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:23.065890 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:23.229779 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] For port f08a96b6-1468-4818-b7dd-1d27381138b0, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=f08a96b6-1468-4818-b7dd-1d27381138b0,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:23.230405 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:23.374665 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aabfa38-3ffb-4ae4-a488-6dd7f6c4fa1c req-08f86441-0954-4f22-8d7e-a08028c80ea4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:23.376143 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4aabfa38-3ffb-4ae4-a488-6dd7f6c4fa1c req-08f86441-0954-4f22-8d7e-a08028c80ea4 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 945 time: 0.0993907 May 20 20:50:23.376939 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Calling delete_port for f08a96b6-1468-4818-b7dd-1d27381138b0 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:23.423390 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-4aabfa38-3ffb-4ae4-a488-6dd7f6c4fa1c req-d9f7b0fd-6575-43f2-a737-1aa4fa89098d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404074 May 20 20:50:23.491418 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:23.496726 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-96a16734-9fd0-45d1-8cfc-add90f71012d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:23.544176 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event deleted for resources: {'Port': ['ID=f08a96b6-1468-4818-b7dd-1d27381138b0,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:23.547139 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:23.621495 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] No DVR routers for this DVR port f08a96b6-1468-4818-b7dd-1d27381138b0 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:50:23.624103 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:23.626654 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'name': 'network-vif-deleted', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:50:23.644307 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-dfcc2138-6c28-401f-95a1-05c32568cf70 req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "DELETE /v2.0/ports/f08a96b6-1468-4818-b7dd-1d27381138b0 HTTP/1.1" status: 204 len: 173 time: 0.7402017 May 20 20:50:23.673608 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c030218-932a-493f-8bc8-5150f880752a', 'name': 'network-vif-deleted', 'tag': 'f08a96b6-1468-4818-b7dd-1d27381138b0', 'status': 'completed', 'code': 200} May 20 20:50:24.695604 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-79992fa8-3999-4af0-a3f6-f345295f270f req-cbf9d700-b00b-4d2b-95e5-fc6d6e89e266 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=3c030218-932a-493f-8bc8-5150f880752a HTTP/1.1" status: 200 len: 210 time: 0.1501539 May 20 20:50:26.137376 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f08a96b6-1468-4818-b7dd-1d27381138b0 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:26.171755 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: f08a96b6-1468-4818-b7dd-1d27381138b0 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:26.172135 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device f08a96b6-1468-4818-b7dd-1d27381138b0 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:26.378287 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-7e94bf1d-cafc-4efc-925c-60556e5af3d1 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1622255 May 20 20:50:26.521318 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-e5113106-3c26-4f84-95a3-2a429a9d124f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:26.522647 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-e5113106-3c26-4f84-95a3-2a429a9d124f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1098 time: 0.0720677 May 20 20:50:26.671113 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-1716f70b-b945-4395-bdc9-8f6fc5eb2837 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:26.672592 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-1716f70b-b945-4395-bdc9-8f6fc5eb2837 service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1253679 May 20 20:50:26.773883 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-aea537cf-d28c-4fc6-83ae-9d99f48b8313 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 1001 time: 0.0916874 May 20 20:50:26.840257 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-43170278-2544-47f6-8196-65bf3e7858ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:26.841662 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-43170278-2544-47f6-8196-65bf3e7858ae service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0597095 May 20 20:50:26.917874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-23b5f846-c4bf-46f4-8ce3-6e15960f75d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:26.919576 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-23b5f846-c4bf-46f4-8ce3-6e15960f75d8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0690999 May 20 20:50:27.057564 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-c05caa96-f985-4602-9332-1e64e734efa0 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278534 May 20 20:50:27.200152 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-93998a3c-e3f7-4064-b49a-6ab9febf6b33 req-23f66f22-4fef-42ae-8641-ecd002473fa4 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1342094 May 20 20:50:28.194575 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47830) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:28.458841 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Deleting port d07da8b7-8ed3-4530-8c7b-c97d86ebfe73 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:28.459103 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:28.584131 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:28.584458 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:28.709688 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Calling delete_port for d07da8b7-8ed3-4530-8c7b-c97d86ebfe73 owned by network:floatingip {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:28.830302 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:28.834615 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-93167217-bf80-4aa6-b166-3194b142240f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:28.905156 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event deleted for resources: {'Port': ['ID=d07da8b7-8ed3-4530-8c7b-c97d86ebfe73,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:28.911353 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:28.969410 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:28.969683 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.db.l3_db [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Floating IP f68aabf2-74d3-4445-8a3d-cce3f0f926d5 disassociated (deleted). External IP: 172.27.3.201, port: a75ba429-37e3-43b6-840e-f1561ae0d109. May 20 20:50:29.406120 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:50:29.584359 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:50:29.593427 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:50:29.600304 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:29.602738 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:29.603346 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:29.655036 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "DELETE /v2.0/floatingips/f68aabf2-74d3-4445-8a3d-cce3f0f926d5 HTTP/1.1" status: 204 len: 168 time: 1.4593637 May 20 20:50:29.655687 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:50:29.703660 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'status': 'completed', 'code': 200} May 20 20:50:29.792220 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:29.812003 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735c0329-5a6c-4976-a792-b73f850497f9 req-fd1efed1-75d7-4c55-a3ce-73cf56ea341c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:29.813660 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-735c0329-5a6c-4976-a792-b73f850497f9 req-fd1efed1-75d7-4c55-a3ce-73cf56ea341c service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0fc67707e21b4394989903515082b61d&device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 1098 time: 0.0808177 May 20 20:50:30.010468 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735c0329-5a6c-4976-a792-b73f850497f9 req-a373e2d0-1d1c-4a6f-a83e-a1b2f2154dce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:30.011861 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-735c0329-5a6c-4976-a792-b73f850497f9 req-a373e2d0-1d1c-4a6f-a83e-a1b2f2154dce service neutron] 10.222.0.69 "GET /v2.0/networks?id=9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 200 len: 913 time: 0.1857486 May 20 20:50:30.093090 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-735c0329-5a6c-4976-a792-b73f850497f9 req-00fc90bc-4530-459f-9009-a61a722d2ab7 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 200 len: 217 time: 0.0674350 May 20 20:50:30.158883 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a008c003-f191-4800-8643-aec7b251385e req-80b0eee8-971b-4ce6-a83a-c250e4b626a9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:30.159685 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-a008c003-f191-4800-8643-aec7b251385e req-80b0eee8-971b-4ce6-a83a-c250e4b626a9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:50:30.159856 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:30.163602 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:50:30.172629 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:30.173245 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:08Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:30.182899 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735c0329-5a6c-4976-a792-b73f850497f9 req-587253a7-f643-4964-a07f-0cda0b1d62dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:30.184588 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-735c0329-5a6c-4976-a792-b73f850497f9 req-587253a7-f643-4964-a07f-0cda0b1d62dc service neutron] 10.222.0.69 "GET /v2.0/subnets?id=5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 200 len: 851 time: 0.0799477 May 20 20:50:30.185789 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-a008c003-f191-4800-8643-aec7b251385e req-80b0eee8-971b-4ce6-a83a-c250e4b626a9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:50:30.186796 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a008c003-f191-4800-8643-aec7b251385e req-80b0eee8-971b-4ce6-a83a-c250e4b626a9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 945 time: 0.2240226 May 20 20:50:30.286836 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-a008c003-f191-4800-8643-aec7b251385e req-bd243a8e-dabc-420d-b078-01e7677fbf2f tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0640943 May 20 20:50:30.302792 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735c0329-5a6c-4976-a792-b73f850497f9 req-a0b5baf7-e686-4303-aae4-ec3cec1d747f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:30.304298 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-735c0329-5a6c-4976-a792-b73f850497f9 req-a0b5baf7-e686-4303-aae4-ec3cec1d747f service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=9997745d-f55f-4dcf-a08c-5d192080ee30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1121767 May 20 20:50:30.354079 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:30.446928 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-735c0329-5a6c-4976-a792-b73f850497f9 req-c2933b20-57f7-4bd7-98dc-49b67b5d1db6 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1308570 May 20 20:50:30.581403 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-735c0329-5a6c-4976-a792-b73f850497f9 req-28aeb60f-ea4d-41bf-8c40-7bb803001071 service neutron] 10.222.0.69 "GET /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265719 May 20 20:50:30.676546 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:30.681087 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1aa7461-b865-45b3-ba91-872c73e3d9f5 None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:42:02Z', 'revision_number': 4, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi', '_interfaces': [{'id': '8aa5b8c0-1a39-4704-97c1-04489bd936cd', 'name': '', 'network_id': '9997745d-f55f-4dcf-a08c-5d192080ee30', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'mac_address': 'fa:16:3e:b1:fe:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:01Z', 'updated_at': '2021-05-20T20:42:09Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'subnets': [{'id': '5f15ab56-6f84-44c6-ba41-332f6baa9746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:50:30.874957 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36ecce24-f066-4ae5-987c-bfcdcab395e2 None None] New status for floating IP f68aabf2-74d3-4445-8a3d-cce3f0f926d5: DOWN {{(pid=91648) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 20 20:50:31.473618 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e954982f-3304-401e-bab1-378d4c154cd3 req-ca0f6029-5a6e-455a-9fa0-9a5c5499c469 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91645) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:31.474987 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e954982f-3304-401e-bab1-378d4c154cd3 req-ca0f6029-5a6e-455a-9fa0-9a5c5499c469 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 945 time: 0.0803115 May 20 20:50:31.518833 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [req-e954982f-3304-401e-bab1-378d4c154cd3 req-7e38a219-e858-48b2-b562-4392184145bc tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/security-groups?id=68fab0cc-a704-4908-b5f6-79379e2689f7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380471 May 20 20:50:31.856568 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-77d52f1d-fadf-44ae-b4ad-29c468aaad3e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91646) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 20 20:50:31.857880 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-77d52f1d-fadf-44ae-b4ad-29c468aaad3e tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 945 time: 0.0788019 May 20 20:50:32.103003 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Deleting port a75ba429-37e3-43b6-840e-f1561ae0d109 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:32.103477 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:32.239826 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] For port a75ba429-37e3-43b6-840e-f1561ae0d109, host hv-cinder-78462, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78462',level=0,port_id=a75ba429-37e3-43b6-840e-f1561ae0d109,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:32.240192 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:32.365848 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Calling delete_port for a75ba429-37e3-43b6-840e-f1561ae0d109 owned by compute:nova {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:32.479008 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:32.484883 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-29d4bf9d-6dce-4902-8008-37756afa6273 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:32.533563 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event deleted for resources: {'Port': ['ID=a75ba429-37e3-43b6-840e-f1561ae0d109,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:32.567800 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:32.614247 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] No DVR routers for this DVR port a75ba429-37e3-43b6-840e-f1561ae0d109 on host hv-cinder-78462 {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:50:32.616821 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for port, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:32.620210 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'name': 'network-vif-deleted', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109'}] {{(pid=91646) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 20 20:50:32.670760 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-0aaa9c87-de8d-48c6-ac84-7d19e8a40a22 req-2d69a4ff-7a07-4dcb-80b2-719d80687903 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.69 "DELETE /v2.0/ports/a75ba429-37e3-43b6-840e-f1561ae0d109 HTTP/1.1" status: 204 len: 173 time: 0.8060012 May 20 20:50:32.676746 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-9465f8a3-899a-4d1b-9842-0003816e9796 req-8e35d1e4-53a9-4c92-8a8b-948a4814e771 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Synchronizing usage tracker for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 20 20:50:32.680186 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ee3297e9-8a7e-4b57-8121-62a978319d7d', 'name': 'network-vif-deleted', 'tag': 'a75ba429-37e3-43b6-840e-f1561ae0d109', 'status': 'completed', 'code': 200} May 20 20:50:32.695717 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.quota.resource [req-9465f8a3-899a-4d1b-9842-0003816e9796 req-8e35d1e4-53a9-4c92-8a8b-948a4814e771 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Unset dirty status for tenant:0fc67707e21b4394989903515082b61d on resource:port {{(pid=91646) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 20 20:50:32.697451 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [req-9465f8a3-899a-4d1b-9842-0003816e9796 req-8e35d1e4-53a9-4c92-8a8b-948a4814e771 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "GET /v2.0/ports?device_id=ee3297e9-8a7e-4b57-8121-62a978319d7d HTTP/1.1" status: 200 len: 210 time: 0.0679657 May 20 20:50:33.797978 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47858) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:34.020611 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Deleting port eed294dc-d97b-4845-af8b-b8aacd3b21a1 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:34.020881 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:34.137354 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:34.137676 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:34.262569 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Calling delete_port for eed294dc-d97b-4845-af8b-b8aacd3b21a1 owned by network:floatingip {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:34.378726 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:34.382494 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-8b3c94bc-5260-4c07-bec0-e4c8fbf17ac1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:34.427473 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event deleted for resources: {'Port': ['ID=eed294dc-d97b-4845-af8b-b8aacd3b21a1,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:34.453553 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:34.521486 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for floatingip, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:34.539182 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-966704'] for floatingip, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:34.540375 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-d7a93466-63d8-4200-876a-c532ca66a36d tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "DELETE /v2.0/floatingips/adc130da-76ab-4492-b210-68e3afed3e87 HTTP/1.1" status: 204 len: 168 time: 0.7414217 May 20 20:50:34.849894 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-79d391c3-0a01-43aa-ad19-0a9c44410a7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:35.913240 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.wsgi [-] (91645) accepted ('10.222.0.82', 47874) {{(pid=91645) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:35.987530 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group, before_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:36.018105 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:36.085409 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:36.090869 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-f35df087-21b3-44d9-aedb-ad71b4815915 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:36.106019 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=68fab0cc-a704-4908-b5f6-79379e2689f7,revision_number=None']} {{(pid=91645) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:36.115063 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.115385 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.115783 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.116146 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.116529 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.116895 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.117255 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.117613 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.117970 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.118328 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.118678 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.119034 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91645) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:36.122393 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG oslo_concurrency.lockutils [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:36.128606 dv-cinder-784623-13-iscsi neutron-server[91645]: DEBUG neutron_lib.callbacks.manager [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Notify callbacks [] for security_group, before_response {{(pid=91645) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:36.129718 dv-cinder-784623-13-iscsi neutron-server[91645]: INFO neutron.wsgi [None req-55d9862e-b60d-4bc9-a9f3-1a5c1b69b7c9 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] 10.222.0.82 "DELETE /v2.0/security-groups/68fab0cc-a704-4908-b5f6-79379e2689f7 HTTP/1.1" status: 204 len: 168 time: 0.2154958 May 20 20:50:36.168549 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device a75ba429-37e3-43b6-840e-f1561ae0d109 no longer exists at agent hyperv_hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:36.204086 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] No Port match for: a75ba429-37e3-43b6-840e-f1561ae0d109 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:36.204740 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Device a75ba429-37e3-43b6-840e-f1561ae0d109 not bound to the agent host hv-cinder-78462 {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:37.210540 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47882) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:37.262488 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:37.565446 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-3f3c12f9-eb5d-4438-a670-034cee9ad57e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:38.058082 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:38.395049 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:38.471846 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Deleting port 8aa5b8c0-1a39-4704-97c1-04489bd936cd {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:38.472495 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:38.595374 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] For port 8aa5b8c0-1a39-4704-97c1-04489bd936cd, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=8aa5b8c0-1a39-4704-97c1-04489bd936cd,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:38.595660 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:38.718742 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Calling delete_port for 8aa5b8c0-1a39-4704-97c1-04489bd936cd owned by network:router_interface {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:39.113720 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:39.117190 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c7da56fb-2c0f-4972-8605-ea28bd6f5323 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:39.161069 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Pushing event deleted for resources: {'Port': ['ID=8aa5b8c0-1a39-4704-97c1-04489bd936cd,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:39.164205 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:39.429682 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:39.779213 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Router 54a652d4-d116-469b-8ba9-8eff8bf74de6 has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:50:39.952851 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:50:39.961103 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] Sync routers for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:50:39.965334 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] 10.222.0.82 "PUT /v2.0/routers/54a652d4-d116-469b-8ba9-8eff8bf74de6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7537582 May 20 20:50:39.967975 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47888) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:39.971910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:39.972621 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:40.057577 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:40.147874 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks [] for router, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:40.160196 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: dv-cinder-784623-13-iscsi {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:40.348131 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:40.469887 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '733a6917-9e40-4a57-8e84-63f60a792028', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:50:38Z', 'revision_number': 5, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port': {'id': '733a6917-9e40-4a57-8e84-63f60a792028', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:18:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:41:59Z', 'updated_at': '2021-05-20T20:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:40.473986 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] Checking router: 54a652d4-d116-469b-8ba9-8eff8bf74de6 for host: dv-cinder-784623-13-iscsi {{(pid=91647) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:50:40.483602 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] Routers {'54a652d4-d116-469b-8ba9-8eff8bf74de6'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91647) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:40.484258 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['54a652d4-d116-469b-8ba9-8eff8bf74de6'], 'active': True} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:40.539952 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Deleting port 733a6917-9e40-4a57-8e84-63f60a792028 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:40.540280 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:40.661712 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] For port 733a6917-9e40-4a57-8e84-63f60a792028, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=733a6917-9e40-4a57-8e84-63f60a792028,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:40.662061 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:40.680599 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvr_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] Set router 54a652d4-d116-469b-8ba9-8eff8bf74de6 gateway port host: None {{(pid=91647) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:40.783777 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Calling delete_port for 733a6917-9e40-4a57-8e84-63f60a792028 owned by network:router_gateway {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:40.786746 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_hamode_db [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:50:40Z', 'revision_number': 6, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91647) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:40.790716 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-261dd573-f2c7-4b21-9de7-cfa75232d68c None None] The sync data for ids ['54a652d4-d116-469b-8ba9-8eff8bf74de6'] in dv-cinder-784623-13-iscsi is: [{'id': '54a652d4-d116-469b-8ba9-8eff8bf74de6', 'name': 'tempest-TestVolumeBootPattern-1489691636-router', 'tenant_id': '0fc67707e21b4394989903515082b61d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:41:58Z', 'updated_at': '2021-05-20T20:50:40Z', 'revision_number': 6, 'project_id': '0fc67707e21b4394989903515082b61d', 'gw_port_host': None}] {{(pid=91647) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:50:40.927258 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:40.930656 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6aba9350-40c9-49a7-b13e-5815b57676b2 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:40.973913 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Pushing event deleted for resources: {'Port': ['ID=733a6917-9e40-4a57-8e84-63f60a792028,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:40.977026 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:41.066995 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.241172 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.243375 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.266063 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.266550 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 54a652d4-d116-469b-8ba9-8eff8bf74de6 {{(pid=91646) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:50:41.278757 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.279872 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] 10.222.0.82 "DELETE /v2.0/routers/54a652d4-d116-469b-8ba9-8eff8bf74de6 HTTP/1.1" status: 204 len: 168 time: 1.3108861 May 20 20:50:41.282296 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47892) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:41.342526 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Deleting subnet 5f15ab56-6f84-44c6-ba41-332f6baa9746 {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:50:41.345379 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.392324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.469336 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.721199 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.725177 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:41.761261 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5f15ab56-6f84-44c6-ba41-332f6baa9746,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:41.763952 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:41.767099 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:41.772015 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac80d3b4-1131-4fda-8f53-06b6f82cd939 None None] Network 9997745d-f55f-4dcf-a08c-5d192080ee30 requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:50:41.774456 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-651c505d-dc2c-4484-a80b-d684fe93fcd2 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5f15ab56-6f84-44c6-ba41-332f6baa9746 HTTP/1.1" status: 204 len: 168 time: 0.4912155 May 20 20:50:41.777843 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47896) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:41.888864 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.037264 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] DHCP port deletion for 9997745d-f55f-4dcf-a08c-5d192080ee30 request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:50:42.068377 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Deleting port 678dace7-e21b-4e15-95b9-796babc972bb {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:42.068681 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.101921 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Deleting port 678dace7-e21b-4e15-95b9-796babc972bb {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:42.102305 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.172352 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] For port 678dace7-e21b-4e15-95b9-796babc972bb, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=678dace7-e21b-4e15-95b9-796babc972bb,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:42.172710 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.201617 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] For port 678dace7-e21b-4e15-95b9-796babc972bb, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=678dace7-e21b-4e15-95b9-796babc972bb,segment=NetworkSegment(32ff4298-05a9-47bb-9b1a-5c7862ae42f7),segment_id=32ff4298-05a9-47bb-9b1a-5c7862ae42f7)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:42.202016 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.299915 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Calling delete_port for 678dace7-e21b-4e15-95b9-796babc972bb owned by network:dhcp {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:42.324548 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Calling delete_port for 678dace7-e21b-4e15-95b9-796babc972bb owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:42.355832 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.364023 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b6ba616f-a49c-4d8f-ae36-d4069c7a30c3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:42.382706 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.388340 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:42.413856 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] No DVR routers for this DVR port 678dace7-e21b-4e15-95b9-796babc972bb on host dv-cinder-784623-13-iscsi {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:50:42.417001 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 733a6917-9e40-4a57-8e84-63f60a792028 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:42.442667 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Pushing event deleted for resources: {'Port': ['ID=678dace7-e21b-4e15-95b9-796babc972bb,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:42.445005 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:42.467407 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Pushing event deleted for resources: {'Port': ['ID=678dace7-e21b-4e15-95b9-796babc972bb,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:42.469746 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 733a6917-9e40-4a57-8e84-63f60a792028 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:42.470091 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 733a6917-9e40-4a57-8e84-63f60a792028 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:42.470506 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 678dace7-e21b-4e15-95b9-796babc972bb no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:42.501099 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] No DVR routers for this DVR port 678dace7-e21b-4e15-95b9-796babc972bb on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:50:42.513242 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.513242 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.513242 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.513242 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.514149 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.514149 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.514149 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.514442 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.514765 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.515085 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.515400 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.515714 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784623-13-iscsi {{(pid=91647) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 20 20:50:42.518767 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 678dace7-e21b-4e15-95b9-796babc972bb {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:42.519267 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 678dace7-e21b-4e15-95b9-796babc972bb not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:42.519560 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 8aa5b8c0-1a39-4704-97c1-04489bd936cd no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:42.534768 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.543575 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-1de4cba6-b2ba-4727-b2e8-571d7a636f5b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:42.548310 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9997745d-f55f-4dcf-a08c-5d192080ee30']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:42.556834 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 8aa5b8c0-1a39-4704-97c1-04489bd936cd {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:42.557685 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 8aa5b8c0-1a39-4704-97c1-04489bd936cd not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:42.565970 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32ff4298-05a9-47bb-9b1a-5c7862ae42f7') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:42.566280 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32ff4298-05a9-47bb-9b1a-5c7862ae42f7') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:42.577808 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.593484 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.600780 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Releasing vlan 830 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:50:42.601222 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:50:42.614921 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:50:42.689323 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.693597 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-9802ae81-a0a9-405a-80c1-879464f33d18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:42.706324 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:42.721468 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Pushing event deleted for resources: {'Network': ['ID=9997745d-f55f-4dcf-a08c-5d192080ee30,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:42.725701 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:42.734257 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-c71382ea-dd6a-4b57-849b-68f32ebb69c1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/9997745d-f55f-4dcf-a08c-5d192080ee30 HTTP/1.1" status: 204 len: 168 time: 0.9553244 May 20 20:50:42.737104 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47900) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:43.270701 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-683044'] for router_interface, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:43.759961 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Deleting port 51850bac-7b38-463f-8125-9c56224cfc79 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:43.760298 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:43.879127 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] For port 51850bac-7b38-463f-8125-9c56224cfc79, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=51850bac-7b38-463f-8125-9c56224cfc79,segment=NetworkSegment(807dfd29-e595-4465-a0fd-ac78b3a2c520),segment_id=807dfd29-e595-4465-a0fd-ac78b3a2c520)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:43.879476 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:43.999920 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Calling delete_port for 51850bac-7b38-463f-8125-9c56224cfc79 owned by network:router_interface {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:44.149632 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:44.153872 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ff758e68-1801-4178-b549-ae5c439576a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:44.203603 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Pushing event deleted for resources: {'Port': ['ID=51850bac-7b38-463f-8125-9c56224cfc79,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:44.206055 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:44.474015 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-752563', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-683152'] for router_interface, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:44.821861 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f has already been hosted by L3 agent ea735756-8ef9-41e3-b233-e7634fa1362b {{(pid=91646) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 20 20:50:45.095299 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] Notify agent at l3_agent.dv-cinder-784623-13-iscsi the message routers_updated {{(pid=91646) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 20 20:50:45.103358 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] Sync routers for ids ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'] in dv-cinder-784623-13-iscsi {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 20 20:50:45.112072 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-338562a8-cd72-481c-91d7-13b677003d86 admin admin] 10.222.0.82 "PUT /v2.0/routers/ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3737764 May 20 20:50:45.114131 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] Routers {'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:45.114450 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47904) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:45.114664 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:45.261587 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:45.294564 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] Set router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f gateway port host: dv-cinder-784623-13-iscsi {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:45.296806 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks [] for router, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:45.471836 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:45.546436 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Deleting port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:45.547147 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:45.576539 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'external_fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:50:44Z', 'revision_number': 5, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port': {'id': '7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0', 'name': '', 'network_id': '86a15d61-a97a-4109-a08b-ca9231f239f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:0c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784623-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:42:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a41fc833-05a5-4db1-8e8c-fa7fa38d3cea', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784623-13-iscsi'}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:45.580398 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] Checking router: ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f for host: dv-cinder-784623-13-iscsi {{(pid=91648) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 20 20:50:45.589407 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] Routers {'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'} bound to L3 agent in host dv-cinder-784623-13-iscsi {{(pid=91648) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 20 20:50:45.590008 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-784623-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T20:19:07Z,description=,heartbeat_timestamp=2021-05-20T20:50:38Z,host='dv-cinder-784623-13-iscsi',id=ea735756-8ef9-41e3-b233-e7634fa1362b,load=0,resource_versions=,resources_synced=,started_at=2021-05-20T20:19:07Z,topic='l3_agent')) {'router_ids': ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'], 'active': True} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:45.670162 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] For port 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,segment=NetworkSegment(e154b7e6-c550-4790-a468-97d736bc8feb),segment_id=e154b7e6-c550-4790-a468-97d736bc8feb)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:45.670508 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:45.742703 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_dvr_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] Set router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f gateway port host: None {{(pid=91648) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 20 20:50:45.790871 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Calling delete_port for 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 owned by network:router_gateway {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:45.845098 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.l3_hamode_db [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:50:45Z', 'revision_number': 6, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port_host': None}], 'dv-cinder-784623-13-iscsi', False) {} {{(pid=91648) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:45.849037 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cef414d6-8e02-44fa-b7ae-e1363f3c4188 None None] The sync data for ids ['ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f'] in dv-cinder-784623-13-iscsi is: [{'id': 'ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f', 'name': 'tempest-TestVolumeBootPattern-547805053-router', 'tenant_id': 'e033980e044a4e7bbdb78184080166be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T20:42:05Z', 'updated_at': '2021-05-20T20:50:45Z', 'revision_number': 6, 'project_id': 'e033980e044a4e7bbdb78184080166be', 'gw_port_host': None}] {{(pid=91648) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 20 20:50:45.931225 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:45.935202 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-de1d8801-97bb-4c22-8351-cc6efc984a3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:45.979515 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Pushing event deleted for resources: {'Port': ['ID=7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:45.982478 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:46.069606 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-737039'] for router_gateway, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.238669 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-735097', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2411'] for router, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.240952 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.268175 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-736819'] for router, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.268781 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f {{(pid=91646) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 20 20:50:46.281196 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] Notify callbacks [] for router, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.282294 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-a2ba7a83-0a4c-43e1-96cc-639e728114b6 admin admin] 10.222.0.82 "DELETE /v2.0/routers/ed6cb9a1-5ff0-47a9-83ee-fdbb281bb55f HTTP/1.1" status: 204 len: 168 time: 1.1669631 May 20 20:50:46.284862 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47908) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:46.437990 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.db_base_plugin_v2 [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Deleting subnet 2bb96e03-282c-4ec2-a1ec-d848893f9fca {{(pid=91646) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 20 20:50:46.440885 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.488397 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3852447'] for subnet, precommit_delete_associations {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.573890 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16100183'] for subnet, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.620991 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 51850bac-7b38-463f-8125-9c56224cfc79 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:46.655910 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 51850bac-7b38-463f-8125-9c56224cfc79 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:46.656524 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 51850bac-7b38-463f-8125-9c56224cfc79 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:46.657102 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:46.691089 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:46.691351 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device 7b1f6600-ce0c-48ce-a4b3-1f15333bf6e0 not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:46.832369 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16100168', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829225', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2785420', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3869995'] for subnet, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.837200 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ffae8f7d-e428-40b4-8b02-3d2e075a3a88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:46.876164 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2bb96e03-282c-4ec2-a1ec-d848893f9fca,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:46.878097 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for subnet, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:46.881757 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13b84c76-8d75-41ba-bf93-f6ca54dce6e4 None None] Network ebd2ede6-2eb5-48d9-a114-c29ca4cd817c requested from dv-cinder-784623-13-iscsi {{(pid=91647) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 20 20:50:46.881980 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:46.887137 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-b453c24f-7927-43b5-8cd8-98c961b5a360 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/2bb96e03-282c-4ec2-a1ec-d848893f9fca HTTP/1.1" status: 204 len: 168 time: 0.6013494 May 20 20:50:46.889529 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47912) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:46.997581 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16452879'] for network, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.068926 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Deleting port e9162113-5422-4f6b-8d20-f165d3d4f0cc {{(pid=91646) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:47.069263 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.131882 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] DHCP port deletion for ebd2ede6-2eb5-48d9-a114-c29ca4cd817c request from dv-cinder-784623-13-iscsi {{(pid=91647) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 20 20:50:47.174179 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.db [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] For port e9162113-5422-4f6b-8d20-f165d3d4f0cc, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e9162113-5422-4f6b-8d20-f165d3d4f0cc,segment=NetworkSegment(807dfd29-e595-4465-a0fd-ac78b3a2c520),segment_id=807dfd29-e595-4465-a0fd-ac78b3a2c520)] {{(pid=91646) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:47.174526 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.196155 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] Deleting port e9162113-5422-4f6b-8d20-f165d3d4f0cc {{(pid=91647) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 20 20:50:47.196535 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8742246067155'] for port, before_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.296278 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.db [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] For port e9162113-5422-4f6b-8d20-f165d3d4f0cc, host dv-cinder-784623-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784623-13-iscsi',level=0,port_id=e9162113-5422-4f6b-8d20-f165d3d4f0cc,segment=NetworkSegment(807dfd29-e595-4465-a0fd-ac78b3a2c520),segment_id=807dfd29-e595-4465-a0fd-ac78b3a2c520)] {{(pid=91647) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 20 20:50:47.296587 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681438'] for port, precommit_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.296709 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.plugin [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Calling delete_port for e9162113-5422-4f6b-8d20-f165d3d4f0cc owned by network:dhcp {{(pid=91646) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:47.344941 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2785407'] for port, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.349045 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-2097f6fb-b624-4ccd-84e6-64aa67fcf680 tempest-TestVolumeBootPattern-1562797120 tempest-TestVolumeBootPattern-1562797120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:47.397522 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Pushing event deleted for resources: {'Port': ['ID=e9162113-5422-4f6b-8d20-f165d3d4f0cc,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:47.400573 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:47.402084 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] No DVR routers for this DVR port e9162113-5422-4f6b-8d20-f165d3d4f0cc on host dv-cinder-784623-13-iscsi {{(pid=91646) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:50:47.459897 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] Calling delete_port for e9162113-5422-4f6b-8d20-f165d3d4f0cc owned by network:dhcp {{(pid=91647) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 20 20:50:47.501993 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-16469320', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-829336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-752549', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8742246071242', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8742245656396'] for port, after_delete {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.505538 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:47.517359 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16078808', 'neutron.services.segments.db._delete_segments_for_network-8742246095993'] for network, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.530148 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ebd2ede6-2eb5-48d9-a114-c29ca4cd817c']}} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:47.542280 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '807dfd29-e595-4465-a0fd-ac78b3a2c520') {'for_net_delete': True} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:47.542569 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.services.segments.db [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '807dfd29-e595-4465-a0fd-ac78b3a2c520') {} {{(pid=91646) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 20 20:50:47.548785 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] Pushing event deleted for resources: {'Port': ['ID=e9162113-5422-4f6b-8d20-f165d3d4f0cc,revision_number=None']} {{(pid=91647) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:47.553274 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG oslo_concurrency.lockutils [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:47.554177 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.db.l3_dvrscheduler_db [None req-423700c9-6328-4cda-964e-563b7b40e492 None None] No DVR routers for this DVR port e9162113-5422-4f6b-8d20-f165d3d4f0cc on host dv-cinder-784623-13-iscsi {{(pid=91647) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 20 20:50:47.554288 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8742246107127', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3852432'] for segment, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.571755 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892'] for segment, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.578387 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Releasing vlan 809 on physical network physnet1 to pool {{(pid=91646) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 20 20:50:47.578942 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16097892', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2785322'] for segment, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: Traceback (most recent call last): May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: timer() May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: cb(*args, **kw) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: return func(*args, **kwargs) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: self._notify() May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: self.callback(batched_events) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: event.method(event) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_id = self._get_aggregate_id(event.segment_id) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: aggregate_uuid = self.p_client.list_aggregates( May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: return f(self, *a, **k) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._get(url).json() May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: return self._client.get(url, endpoint_filter=self._ks_filter, May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: return self.request(url, 'GET', **kwargs) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: base_url = self.get_endpoint(auth, allow=allow, May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: auth = self._auth_required(auth, 'determine endpoint URL') May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 20 20:50:47.591738 dv-cinder-784623-13-iscsi neutron-server[91646]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 20 20:50:47.670001 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16078801', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-588188', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-752570', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-737060'] for network, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.673509 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:47.687172 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-752535'] for network, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.697091 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Pushing event deleted for resources: {'Network': ['ID=ebd2ede6-2eb5-48d9-a114-c29ca4cd817c,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:47.701581 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:47.704936 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-ea5f8fcb-644e-419f-8603-229b05e9d71d admin admin] 10.222.0.82 "DELETE /v2.0/networks/ebd2ede6-2eb5-48d9-a114-c29ca4cd817c HTTP/1.1" status: 204 len: 168 time: 0.8144464 May 20 20:50:47.817927 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47918) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:47.864939 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-99222169-7f4c-45a6-983f-efd30e5bd4a8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0fc67707e21b4394989903515082b61d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0457437 May 20 20:50:47.867240 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47922) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:47.924174 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-df863aa5-c2bb-4ea2-afa0-2b825c731369 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:47.949535 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-df863aa5-c2bb-4ea2-afa0-2b825c731369 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:48.004158 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-df863aa5-c2bb-4ea2-afa0-2b825c731369 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:48.007782 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-0bcf58e3-7c03-4164-b276-34310128724c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:48.021013 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df863aa5-c2bb-4ea2-afa0-2b825c731369 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c5ae52b-9b34-4400-b7b8-0caac2cd1253,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:48.024745 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-df863aa5-c2bb-4ea2-afa0-2b825c731369 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:48.029346 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-df863aa5-c2bb-4ea2-afa0-2b825c731369 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:48.030464 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-df863aa5-c2bb-4ea2-afa0-2b825c731369 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0c5ae52b-9b34-4400-b7b8-0caac2cd1253 HTTP/1.1" status: 204 len: 168 time: 0.1622782 May 20 20:50:48.374731 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e9162113-5422-4f6b-8d20-f165d3d4f0cc no longer exists at agent ovs-agent-dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 20 20:50:48.393111 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47930) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:48.411734 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.plugin [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] No Port match for: e9162113-5422-4f6b-8d20-f165d3d4f0cc {{(pid=91647) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 20 20:50:48.412164 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron.plugins.ml2.rpc [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Device e9162113-5422-4f6b-8d20-f165d3d4f0cc not bound to the agent host dv-cinder-784623-13-iscsi {{(pid=91647) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 20 20:50:48.444171 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-1b247105-0586-4a21-9820-6c21e10cc5f9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e033980e044a4e7bbdb78184080166be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0497513 May 20 20:50:48.446359 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [-] (91646) accepted ('10.222.0.82', 47934) {{(pid=91646) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 20 20:50:48.503380 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6cce9bf1-2f54-4ed8-a2c9-fad953fbe59d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:48.528735 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6cce9bf1-2f54-4ed8-a2c9-fad953fbe59d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:48.581764 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6cce9bf1-2f54-4ed8-a2c9-fad953fbe59d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-588110'] for security_group, after_delete {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:48.585605 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-da60bb86-4968-4059-b6b1-132c5e49e75f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 20 20:50:48.596400 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cce9bf1-2f54-4ed8-a2c9-fad953fbe59d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb0e568b-acc3-4552-ba07-2903862cdd1d,revision_number=None']} {{(pid=91646) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 20 20:50:48.600555 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG oslo_concurrency.lockutils [None req-6cce9bf1-2f54-4ed8-a2c9-fad953fbe59d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 20 20:50:48.604860 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron_lib.callbacks.manager [None req-6cce9bf1-2f54-4ed8-a2c9-fad953fbe59d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91646) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:50:48.608258 dv-cinder-784623-13-iscsi neutron-server[91646]: INFO neutron.wsgi [None req-6cce9bf1-2f54-4ed8-a2c9-fad953fbe59d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eb0e568b-acc3-4552-ba07-2903862cdd1d HTTP/1.1" status: 204 len: 168 time: 0.1587429 May 20 20:50:51.791684 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:50:54.106704 dv-cinder-784623-13-iscsi neutron-server[91646]: DEBUG neutron.wsgi [req-aaecca64-adb1-4410-a124-7c6518f2df0c req-9cc93ce8-9085-4203-a85c-3b9fad5c4677 service neutron] (91646) timed out ('10.222.0.82', 43298) {{(pid=91646) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 20 20:51:04.851849 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-576db0aa-b0c9-46f0-9b73-c168e2a2f67e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:07.267598 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:07.566619 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-84ab7b0a-2a52-45fd-be94-e9d1a6431cf1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:08.397808 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:10.009649 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:15.261727 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:28.790985 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:51:34.853525 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-0d25e0f1-21a8-4fee-830b-06fd8ff23819 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:37.271207 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:37.568542 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2035246f-2e0e-45c3-85f0-a577c775c564 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:38.400914 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:40.000679 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:51:45.275075 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:04.857407 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-456f548b-17e4-4240-a945-b835b58a3e3a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:05.790606 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:52:07.273860 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:07.570205 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-4de563ed-8353-4557-838a-89020f676af8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:08.403122 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:10.003317 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:15.289149 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:34.858876 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9e03a86e-f76c-48cf-aa9d-c38e7dcf3f3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:37.275503 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:37.573198 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-8bb8be4d-77af-4540-bec6-9e6cffaaa826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:38.405836 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:40.006180 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:52:42.788825 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:52:45.308622 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:04.861796 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-47a1bcbf-84c5-401e-ac5c-c28a51e7ce9e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:07.279879 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:07.574989 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1d48edca-d94d-4b65-bdd9-475c670293eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:08.410428 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:10.016613 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:15.319307 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:19.787203 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:53:34.862905 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6d17a463-f305-4ac4-aba2-d7e1c9219100 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:37.281598 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:37.576162 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5f223dad-b239-4f00-926c-e5a3fb65aaaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:38.412511 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:40.011498 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:45.336947 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:53:56.785913 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:54:04.865184 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-f982f048-0e3c-4ac2-881c-3fcd964607be None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:07.283255 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:07.577402 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-cad182b7-fa96-439a-ad3e-118938e772b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:08.415049 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:10.012950 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:15.357494 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:33.785573 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:54:34.870220 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-6e7e1a2e-8989-4760-ade9-63a5ace4c9b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:37.285794 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:37.578956 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-12aff5e7-7e46-457e-b487-33980a0992d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:38.417266 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:40.016668 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:54:45.350923 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:04.873100 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-5c7b54c8-e426-47b0-b00b-4e2fd152df61 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:07.288791 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:07.580017 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-9e2a99ab-e77a-4fc6-bb6e-0b85bb03e9e9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:08.421187 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:10.024135 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:10.784373 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:55:15.354501 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:34.874357 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-e55d5cee-e4ca-4da8-b607-293d4e58ed83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:37.290862 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:37.581284 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-2cb4f3bb-b25f-48ed-a0e8-dc38981e4933 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:38.423327 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:40.023055 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:45.384018 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:55:47.782532 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}} May 20 20:56:04.876310 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-959843e7-9bfc-4a24-8598-79150222d91b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:56:07.295610 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-03b72f40-7572-47e0-aaa2-a58ace1bdc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:56:07.584672 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-1339671c-8af0-4a32-b274-19b3dbc1bbd3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:56:08.426286 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-49a1f4c6-1fc2-47d2-ae00-d6cc1bc19963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:56:10.025984 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-a7da2e0d-9c73-485c-947f-d2f29ebced3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:56:15.380799 dv-cinder-784623-13-iscsi neutron-server[91647]: DEBUG neutron_lib.callbacks.manager [None req-7d3ce545-d978-4dd6-bd54-5a355d3b6796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8742246099020', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16074262'] for agent, after_update {{(pid=91647) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 20 20:56:24.781166 dv-cinder-784623-13-iscsi neutron-server[91648]: DEBUG neutron.db.agents_db [None req-4b59e8a1-e566-4f7e-bf01-959310aecc2b None None] Agent healthcheck: found 6 active agents {{(pid=91648) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}